Play with sesame native store for large triples

The Sesame Native Store is reported to scale up to about 100-150 million triples (depending on hardware and data-set characteristics). And Rivuli also mentioned in his blogpost that it is becomeing slow while the data set normally over 600,0000 triples 500MB for inserting files to Native Store of sesame.

Tested for chunk commit in sesame API, see example here, that is, stop auto commit and commit in every chunk size you set.

  • Test: commit every 5 triples, how many will be committed if there's exception in 14th triple(statement)?
    • A: 10
    • B: 13
    • Answer: 13 ( It will be committed before the exception point)


No comments:

Post a Comment