Commits
- Commit:
4ff67682be16c48c098e0412aee07cabd74a1f27
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
detect objects missing from pack file that should be present
- Commit:
387c45f4c7dcbeea29112789e8c87b5bd973ce37
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
fix None-deref
- Commit:
11d49a78db785e502777cd2273407d1902b3ee01
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
allow loader to detect the set of fetched branch and tag names
- Commit:
a2bed2903feedc4ea80d283220d137df051b4d69
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
only check for unknown objects if base snapshots are available
- Commit:
37649c267b5f25a14e911b5273a9185fc3954ca3
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
display amount of packed objects after indexing
- Commit:
a73668185f494dafd7230f3c7b0977bb47f7c46c
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
more debug
- Commit:
a214d0e77727fa17f3384d4e8045f8f1749879cb
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
more tag debug
- Commit:
ea75ac8a3a3df41fafc1233cc14e80eadad81199
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
tag debugging
- Commit:
7c0f5a1425593975d49059f50e2ba6a42d1a61d3
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
for now, send tags to the archive unconditionally
- Commit:
59f842daf3f3d4f07db6375b2c32552556453e86
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
tweak debug
- Commit:
dc6d4f4cddb766959cc8d773a86d6e1cebc53265
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
fix commit processing
- Commit:
cbe1c11028d08815f6840cc4b5fdaeafca82e9ca
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
improve performance and debug log output
- Commit:
91b0caf89ffbcd64c670ddc387741fe9e8901b5e
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
syntactic changes made by black and isort
- Commit:
1abdec0ef115d8c29968fc2eeb22936bff743295
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
reduce storage requests by inferring object presence via dependencies
Query the presence of packed objects in bulk. First look for missing
contents. Assuming topogical loading order, trees, commits, and tags
which depend on these contents will be missing as well. Based on this
assumption we can avoid sending queries about such objects to storage.
The approach was suggested by olasd, but all potential bugs in here are mine.
- Commit:
39b88888999abc64dd5ea2dd56e48bcc639fab15
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
keep track of Git object types in the graph of packed objects
- Commit:
aaff2b2add7c25bd5ab8c1ad8936e2c808b87e29
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
fix typo in test name
- Commit:
990e70e8bba83e9cb735aa621d7f08058ded32eb
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
traverse a given tree object only once; many commits can contain it
- Commit:
60aa31fc9deb166a04e11747a25d0f4966d3e42a
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
the pointer between commits must point the other way
pointed out by olasd
- Commit:
19231ab78f7566fb47c90eb83ccc54d4341bc176
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
add all commits found in pack file to the graph, not just tip commits
pointed out by olasd
- Commit:
f6c9bf1db2d2902e0c4f9ac99825e270f101a794
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
exclude submodules from the packed object graph
pointed out by olasd
- Commit:
3f6425401a22f5010346a180a91b7d65d4715c43
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
use igraph to store our graph of packed git objects
- Commit:
948ae59d4196b17d4098e50439b8cc7e728b308e
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
build a graph of objects found in the pack file
Not used yet, still WIP.
- Commit:
971c04d1b79f92a74c42df10efba38fddf2ad006
- From:
- Stefan Sperling <stsp@stsp.name>
- Date:
make the Git loader load objects in topological order
The Git loader will now send objects to storage in topological Git DAG order.
There is no support for topological order in the dumb loader yet because
the current implementation assumes that a single pack file will be fetched
from the server.
The tests are passing, except for these 4:
TestGitLoader::test_metrics
TestGitLoader::test_metrics_filtered
TestGitLoader2::test_load_incremental
TestGitLoader2::test_load_incremental_from[partial-parent-and-empty-previous]
It seems these tests depend on assumptions that are no longer valid once objects
get loaded in topological order?
The implementation does not yet handle edge cases such as tags pointing
at non-commit objects.
- Commit:
0dd744df1d1192d4eeb3fbe38c96cce76bda7376
- From:
- Antoine Lambert <anlambert@softwareheritage.org>
- Date:
tests: Fix numerous tests after recent changes in loader-core
BaseLoader.load now returns a dict with an extra error field when
a loading fails.
- Commit:
48d0acfaa13b01fa5b9dd9d9ea42ffdfb7daf86d
- From:
- Renaud Boyer <renaud.boyer@sofwareheritage.org>
- Date:
Fix Commit.extra is deprecated