added counters to keep track of the relationships provenance
new tst for claim updates
updated opentrial sample record
excluding dateoftransformation from metadata fields, it should be serialised only in the record header
Added dr:dateOfTransformation to some test XML files.For publications dr:dateOfCollection must be set.For datasets dri:dateOfCollections must be set.
Testing OpenTrials dataset record mapping. Depending on snapshot parent.
import cleanup
reverting, we need less getters
tests for dedup experiments
added more getters
dedup experiments
added mapper class for hdfs actions
cleanup
added Mapper class PromoteActionSetFromHDFS
added anchorStats map-only job
added counter for DOIs
removing useless counters
using most recent dnet-pace-core features
fixed DedupDeleteRelMapper
do not export deleted entities
adapted to the removal of contributors as relationships
added utility methods to deal with strings rather than byte[]
sort merged ids
log the documents being compared before failing
test for ARC
introducing support for projects that doesn't provide a link to a specific fundingpath.
implemented job and workflow to export the openaire identifiers
log the number of items clustered on each key
do not consider deleted entities
New test for openaire2.0_data compliance for datasets
updating to dnet-openaire-data-protos:3.5.0
updated to dnet-openaire-data-protos:3.5.0-SNAPSHOT
cleanup, extended tests to include new relationships and mapping profiles
counters
counter test
Tests load gthe XSLT from the TDSRule profiles in dnet-openaireplus-profiles
Back to revision r39888 and updated pom and sh files
added possibility to post-process the result stored in the index documents
ticket #1588 Rename "native" compatibility to "proprietary"
use of external properties
added min distance algorithm, used to identify the connected components (dedup)
limit the job to insttitutional pubsrepository
counter labels
use of Text instead of ImmutableBytesWritable
reimplemented calculatePersonDistribution M/R job to consider only the results from pubsrepositories (not journals)
reuse the same outkey and outvalue objects
added more mapping tests, using xslt picked from services.openaire
spring makes me lazy
added infospace dump mapper
added information space export job
testing umlauts
updated to the new mongodb driver specs
Null values for FP7 and H2020 specific fields about OA mandate and Data Pilot.
Do not check the status of a record: we assume we have to insert it because the OAI store is built in refresh mode.
OAIStore with compressed bodies. FCurrently for beta only.
fixed tests, added new dedup specific jobs
added implementors for offline dedup person workflow