Project

General

Profile

Activity

From 10/08/2014 to 08/09/2014

08/09/2014

06:11 PM Revision 30058 (dnet40): propagation of excepions as JSON objects
Michele Artini
05:44 PM Revision 30057 (dnet40): #597 adding svn.repository,svn.path properties in version.properties file
Marek Horst
05:43 PM Revision 30056 (dnet40): #614 introducing monitor profile dedicated for monitoring oozie job progress and propagating final job status as maven result. Upgrading exec-maven-plugin to 1.3.2 in order to allow dumping stdout to file which was added in deploy profile to allow job identifier extraction
Marek Horst
05:19 PM Revision 30055 (dnet40): introducing oozie maven plugin required by IIS build system for monitoring oozie progress of executed job
Marek Horst
05:15 PM Revision 30054 (dnet40): Share project "icm-iis-oozie-maven-plugin" into "https://svn.driver.research-infrastructures.eu/driver"
Marek Horst
04:58 PM Revision 30053 (dnet40): prepare shutdown
Michele Artini
04:39 PM Revision 30052 (dnet40): - Added interface and client implementation for mdstore service
- Changes in validator to support reading from mdstores. Antonis Lempesis
11:39 AM Revision 30049 (dnet40): updating job.properties
Marek Horst

05/09/2014

06:16 PM Revision 30045 (dnet40): should fix __result field serialization
Claudio Atzori
06:16 PM Revision 30044 (dnet40): Finalized workflow
Eri Katsari
06:13 PM Revision 30043 (dnet40): fixed bug with null values on result date
Eri Katsari
06:13 PM Revision 30042 (dnet40): fixed bug with null values on result date
Eri Katsari
06:07 PM Revision 30041 (dnet40): updated metadata format profile
Claudio Atzori
06:07 PM Revision 30040 (dnet40): updated required parameters
Claudio Atzori
06:06 PM Revision 30039 (dnet40): lookup for "solr" as backendId
Claudio Atzori
06:05 PM Revision 30038 (dnet40): added created index node
Claudio Atzori
05:54 PM Revision 30037 (dnet40): fixed handling of unexisting set
Alessia Bardi
01:58 PM Revision 30033 (dnet40): Added Stoppable Interface
Michele Artini
01:46 PM Revision 30032 (dnet40): release connection
Claudio Atzori
01:43 PM Revision 30031 (dnet40): indexing wf uses the new index service specs
Claudio Atzori

04/09/2014

11:53 PM Revision 30026 (dnet40)
Eri Katsari
09:27 PM Revision 30025 (dnet40)
Eri Katsari
09:02 PM Revision 30024 (dnet40)
Eri Katsari
08:57 PM Revision 30023 (dnet40)
Eri Katsari
08:53 PM Revision 30022 (dnet40)
Eri Katsari
05:51 PM Revision 30021 (dnet40): stats update moved to dedicated wf
Claudio Atzori
05:39 PM Revision 30020 (dnet40)
Eri Katsari
05:38 PM Revision 30019 (dnet40): updated date format for projects
Eri Katsari
04:08 PM Revision 30017 (dnet40): removed CDATA from extraInfo payloads
Claudio Atzori
04:05 PM Revision 30015 (dnet40): text labels
Michele Artini
02:44 PM Revision 30009 (dnet40): Error details
Michele Artini
01:10 PM Revision 30006 (dnet40): setting export_action_set_id_entity_dataset to $UNDEFINED$ by default, this should not be required because dataset reference extraction module might be deactivated. Check will be performed at dataset entity exporter module and when value is not set - exception will be raised.
Marek Horst
11:44 AM Revision 30005 (dnet40): using CloudSolrServer for parallel index feeding
Claudio Atzori
11:03 AM Revision 30003 (dnet40): added js library to use the LocalStorage
Michele Artini

03/09/2014

09:42 PM Revision 30001 (dnet40)
Eri Katsari
09:35 PM Revision 30000 (dnet40)
Eri Katsari
09:34 PM Revision 29999 (dnet40)
Eri Katsari
09:34 PM Revision 29998 (dnet40)
Eri Katsari
09:28 PM Revision 29997 (dnet40)
Eri Katsari
09:19 PM Revision 29996 (dnet40)
Eri Katsari
09:10 PM Revision 29995 (dnet40)
Eri Katsari
07:39 PM Revision 29994 (dnet40)
Eri Katsari
07:33 PM Revision 29993 (dnet40)
Eri Katsari
07:29 PM Revision 29992 (dnet40)
Eri Katsari
07:28 PM Revision 29991 (dnet40)
Eri Katsari
07:05 PM Revision 29989 (dnet40): added flags to enable/disable metadata extraction module
Claudio Atzori
06:32 PM Revision 29988 (dnet40): removing empty package
Marek Horst
06:04 PM Revision 29987 (dnet40)
Eri Katsari
05:58 PM Revision 29985 (dnet40): added flags to enable/disable metadata extraction module
Claudio Atzori
05:53 PM Revision 29982 (dnet40): #757 temporarily disabling PMC ingestion until fixing openaire identifiers building process
Marek Horst
04:25 PM Revision 29981 (dnet40)
Eri Katsari
03:28 PM Revision 29980 (dnet40): fix-back location
Andrea Mannocci
03:28 PM Revision 29979 (dnet40): added two sample vocabularies
Andrea Mannocci
02:36 PM Revision 29978 (dnet40): Implemented reloading of index once the schema is updated
Sandro La Bruzzo
12:50 PM Revision 29976 (dnet40): minor fix
Michele Artini
12:47 PM Revision 29975 (dnet40): implemented xquery history (max 100 elements)
Michele Artini
12:44 PM Revision 29974 (dnet40): changed actions from Resource to Autowired to allow the container to start also if there is no SubscriptionAction bean defined
Sandro La Bruzzo
12:42 PM Revision 29973 (dnet40): implemented MDFormato Notification handler
Sandro La Bruzzo
12:00 PM Revision 29972 (dnet40): added action sets dedicated to each inference module
Claudio Atzori
12:00 PM Revision 29971 (dnet40): added action sets dedicated to each inference module
Claudio Atzori
11:55 AM Revision 29970 (dnet40): repo filter using activation api status
Michele Artini
11:35 AM Revision 29969 (dnet40)
Eri Katsari
11:15 AM Revision 29968 (dnet40): introduced a check for NaN in TMGeo.xsl
Andrea Mannocci
11:04 AM Revision 29967 (dnet40): #568, #577 enabling proper citations export by introducing PMC citation ingestion and citation matching outcome merging and grouping for exporting purposes. Introducing union instead of collapser which should be introduced in near future.
Marek Horst
10:46 AM Revision 29966 (dnet40): updated jobs specs
Claudio Atzori
10:40 AM Revision 29965 (dnet40): aligned parameters with job specs
Claudio Atzori
10:00 AM Revision 29964 (dnet40): this container uses a branch index service with SOLR embedded 4.3.1
Andrea Mannocci
09:57 AM Revision 29963 (dnet40): fixed path to cleaning scriptts in WF
Andrea Mannocci
09:56 AM Revision 29962 (dnet40): uris cleaning scripts
Andrea Mannocci
09:44 AM Revision 29961 (dnet40): sticking to solr 4.7.0 for code executed on the hadoop cluster, until java 1.7 won't be available
Claudio Atzori
12:48 AM Revision 29960 (dnet40)
Eri Katsari

02/09/2014

10:31 PM Revision 29959 (dnet40)
Eri Katsari
10:28 PM Revision 29958 (dnet40)
Eri Katsari
10:27 PM Revision 29957 (dnet40)
Eri Katsari
07:15 PM Revision 29956 (dnet40): picked updated implementation from cnr-index-solr-common
Claudio Atzori
06:50 PM Revision 29955 (dnet40): updated IIS specific property
Claudio Atzori
06:27 PM Revision 29954 (dnet40): Added multivalued="false" when needed on organisations, datasources and persons.
Alessia Bardi
06:09 PM Revision 29953 (dnet40): added multivalued="false" for fields needed for sorting
Claudio Atzori
06:01 PM Revision 29952 (dnet40): added integration
Sandro La Bruzzo
05:59 PM Revision 29951 (dnet40): added files
Sandro La Bruzzo
05:58 PM Revision 29950 (dnet40): moved in the right folder
Sandro La Bruzzo
05:57 PM Revision 29949 (dnet40): added trunk
Sandro La Bruzzo
05:57 PM Revision 29948 (dnet40): created dnet-data container
Sandro La Bruzzo
05:23 PM Revision 29946 (dnet40): added branch name
Claudio Atzori
05:22 PM Revision 29945 (dnet40): updated param name and values
Claudio Atzori
05:13 PM Revision 29944 (dnet40): updated xpath for text selection
Andrea Mannocci
05:12 PM Revision 29943 (dnet40): updated G.Bodard scripts
Andrea Mannocci
05:07 PM Revision 29942 (dnet40): fixed schema value
Claudio Atzori
03:32 PM Revision 29938 (dnet40): branch of cnr-solr-index-service working with solr 4.3.1 fixed version.
Andrea Mannocci
03:29 PM Revision 29937 (dnet40): this branch uses solr 4.3.1 instead of dnet-parent property apache.solr.version being equal to 4.9
Andrea Mannocci
02:49 PM Revision 29936 (dnet40): removing memory related properties, fixing #757 should solve all memory related problems
Marek Horst
02:12 PM Revision 29935 (dnet40): added note for Zenodo when the institution cannot be found in our db. Fixing part of #745
Katerina Iatropoulou
01:22 PM Revision 29934 (dnet40): Fixed bug with datatasource to hbase wf
Michele Artini
01:22 PM Revision 29933 (dnet40): Added node to launch generic sql commands
Use of alternative methods for sql queries Michele Artini
12:27 PM Revision 29932 (dnet40): updated port number
Claudio Atzori
12:11 PM Revision 29931 (dnet40)
Eri Katsari
12:01 PM Revision 29930 (dnet40)
Eri Katsari
11:43 AM Revision 29929 (dnet40)
Eri Katsari
11:42 AM Revision 29928 (dnet40)
Eri Katsari
11:02 AM Revision 29927 (dnet40): fix a rendering bug
Michele Artini
10:41 AM Revision 29926 (dnet40)
Eri Katsari
10:06 AM Revision 29924 (dnet40): set hbase dir to props
Eri Katsari

01/09/2014

11:15 PM Revision 29922 (dnet40)
Eri Katsari
05:39 PM Revision 29921 (dnet40): update in dependencies
Andrea Mannocci
03:34 PM Revision 29920 (dnet40): cache invalidation when compliance is updated
Michele Artini
03:28 PM Revision 29919 (dnet40): xquery performance
Michele Artini
12:31 PM Revision 29918 (dnet40): added oozie endpoint for DM cluster@ICM
Claudio Atzori
12:25 PM Revision 29917 (dnet40): updated provision wf
Claudio Atzori

29/08/2014

06:29 PM Revision 29914 (dnet40): #568 introducing citations grouping by sourceDocumentId, still to be adjusted for ingested pmc citations outcome which currently seems to hang up
Marek Horst
06:25 PM Revision 29913 (dnet40): fixing NPEx
Marek Horst
06:06 PM Revision 29912 (dnet40): removed unused total value
Michele Artini
04:42 PM Revision 29911 (dnet40): updated wf definition
Claudio Atzori
04:27 PM Revision 29910 (dnet40): reused wf definitions instead of dubling them in a dedicated load wf
Claudio Atzori
11:53 AM Revision 29906 (dnet40): #577 introducing UDF producing empty map, two transformers building common Citation datastore from citationmatching and pmc ingestion outcome. Both are required by collapser.
Marek Horst
10:57 AM Revision 29905 (dnet40): updated branch version and build scripts
Claudio Atzori
10:57 AM Revision 29904 (dnet40): minor fix
Michele Artini
10:50 AM Revision 29903 (dnet40): update branch with contributes from trunk and other branches
Claudio Atzori

28/08/2014

08:30 PM Revision 29902 (dnet40): setting confidence level to 1*factor when not specified
Marek Horst
08:28 PM Revision 29901 (dnet40): removing redundant code
Marek Horst
08:23 PM Revision 29900 (dnet40): #577 updating Citation namespace
Marek Horst
07:24 PM Revision 29899 (dnet40): #577 introducing common.citations.Citation schema
Marek Horst
06:34 PM Revision 29898 (dnet40): #597 reintroducing changes supplemented with org.tmatesoft.svnkit:svnkit:1.8.5 explicitly defined depedency
Marek Horst
06:16 PM Revision 29897 (dnet40): #597 reverting svn version related changes until resolving 1.8 svn client issues
Marek Horst
04:51 PM Revision 29896 (dnet40): refactoring of the repoUI homepage
Michele Artini
04:32 PM Revision 29895 (dnet40): updating expected output
Marek Horst
02:35 PM Revision 29894 (dnet40): 3rd round of fixes due to Europeana feedback
Andrea Mannocci
01:38 PM Revision 29893 (dnet40): removing output_citation_pmc port duplicate
Marek Horst
11:40 AM Revision 29892 (dnet40): fixed a problem with an ajax call
Michele Artini
11:06 AM Revision 29891 (dnet40): aligned with solr 4.9
Claudio Atzori
11:05 AM Revision 29890 (dnet40): bumped solr version
Claudio Atzori
11:04 AM Revision 29889 (dnet40): http post header
Michele Artini
10:57 AM Revision 29888 (dnet40)
Eri Katsari

27/08/2014

05:59 PM Revision 29887 (dnet40): 2nd round of fixes due to Europeana feedback
Andrea Mannocci
05:41 PM Revision 29886 (dnet40): use of the extrafield that overrides the api compliance for the creation of the hbase datasource records
Michele Artini
04:42 PM Revision 29885 (dnet40): minor fix
Michele Artini
04:33 PM Revision 29884 (dnet40): use of an extrafield to override the api compliance
Michele Artini
12:48 PM Revision 29883 (dnet40): expected record updated
Dominika Tkaczyk
12:42 PM Revision 29882 (dnet40): #597 deploying svn version in oozie_app/version.properties file
Marek Horst
12:03 PM Revision 29881 (dnet40): - extrafields management
- added a method to override the compliance Michele Artini
11:43 AM Revision 29880 (dnet40): removing redundant ReferenceBasicMetadata and ReferenceMetadata definitions which are also available in standalone avdl definitions, replacing definitions with import statements.
Marek Horst
11:24 AM Revision 29879 (dnet40): minor fix
Michele Artini
11:16 AM Revision 29878 (dnet40): updated finalize node
Claudio Atzori

26/08/2014

06:47 PM Revision 29876 (dnet40): Updated documentation to state which fields is applicable only to datasets or only to publications (see #744 and Result.proto)
Alessia Bardi
06:13 PM Revision 29875 (dnet40): base query set for OAI export
Andrea Mannocci
05:29 PM Revision 29874 (dnet40): changed dependency from cnr-enabling-services to cnr-service-common
Sandro La Bruzzo
05:29 PM Revision 29873 (dnet40): added params to solrconfig: ramBufferSizeMB, mergeFactor, termIndexInterval
Sandro La Bruzzo
04:48 PM Revision 29872 (dnet40): changed to pending
Andrea Mannocci
04:35 PM Revision 29871 (dnet40): prepending labels giving context to vocabulary terms
Andrea Mannocci
04:19 PM Revision 29870 (dnet40)
Andrea Mannocci
04:03 PM Revision 29869 (dnet40): first round of fixes due to Europeana feedback
Andrea Mannocci
03:44 PM Revision 29868 (dnet40): See ticket #708: 'file::hybrid' term is missing from 'D-Net Content Description Typologies' vocabulary
Alessia Bardi
02:58 PM Revision 29867 (dnet40): added some log debug
Sandro La Bruzzo
02:39 PM Revision 29866 (dnet40): fixed IPR for images
Andrea Mannocci
12:14 PM Revision 29865 (dnet40): force default general ipr statement
Andrea Mannocci
12:08 PM Revision 29864 (dnet40): forced module to be compiled with java 6
Claudio Atzori
11:47 AM Revision 29863 (dnet40)
Andrea Mannocci
11:32 AM Revision 29862 (dnet40): added property prefixes
Claudio Atzori
11:30 AM Revision 29861 (dnet40): added m/r specific properties
Claudio Atzori
11:14 AM Revision 29860 (dnet40): changed properties passed to index feed m/r job
Claudio Atzori
11:09 AM Revision 29859 (dnet40): added solr webContext
Claudio Atzori
10:32 AM Revision 29858 (dnet40): fixed pom and scripts
Claudio Atzori
10:31 AM Revision 29857 (dnet40): branch to test the new index feeding libs
Claudio Atzori

25/08/2014

06:15 PM Revision 29856 (dnet40): updated index feed job to make use of the new shared solr lib
Claudio Atzori
06:09 PM Revision 29855 (dnet40): updating performance test
Marek Horst
06:06 PM Revision 29854 (dnet40): moving ACM importer to icm-iis-mainworkflows due to extending dependances with cermine, introducing performance tests
Marek Horst
06:06 PM Revision 29853 (dnet40): moving ACM importer to icm-iis-mainworkflows due to extending dependances with cermine, introducing performance tests
Marek Horst
05:33 PM Revision 29852 (dnet40): removed deploy info
Sandro La Bruzzo
05:33 PM Revision 29851 (dnet40): added deploy info
Sandro La Bruzzo
05:31 PM Revision 29850 (dnet40): branch to test the new index feeding libs
Claudio Atzori
05:29 PM Revision 29849 (dnet40): moved StreamingInputDocumentFactory to dnet-index-solr-common
Sandro La Bruzzo
04:53 PM Revision 29848 (dnet40): show the current size when current > total
Michele Artini
04:46 PM Revision 29847 (dnet40): moved dependency to solr from dnet-index-client to dnet-index-solr-client
Sandro La Bruzzo
04:45 PM Revision 29846 (dnet40): removed dependency to solr
Sandro La Bruzzo
04:22 PM Revision 29845 (dnet40): Show of inaccurate size in progressJobNode
Michele Artini
04:13 PM Revision 29844 (dnet40): added ignore property
Sandro La Bruzzo
04:11 PM Revision 29843 (dnet40): added standard maven folder
Sandro La Bruzzo
04:07 PM Revision 29842 (dnet40): added pom
Sandro La Bruzzo
03:57 PM Revision 29841 (dnet40): added trunk
Sandro La Bruzzo
03:57 PM Revision 29840 (dnet40): create module dnet-index-solr-common
Sandro La Bruzzo
02:14 PM Revision 29839 (dnet40): convertBibEntry() made public
Dominika Tkaczyk
12:56 PM Revision 29837 (dnet40): New examples in the docsim demonstrator, matching the new database content
Mateusz Kobos
12:55 PM Revision 29836 (dnet40): updating default job properties
Marek Horst

22/08/2014

05:38 PM Revision 29835 (dnet40): removing common import input parameters which are not required in this context
Marek Horst
05:34 PM Revision 29834 (dnet40): removing 'import' directory creation and removal which was obsolete
Marek Horst
05:27 PM Revision 29833 (dnet40): checking whether trust level is empty before comparing to predefined threshold
Marek Horst
04:57 PM Revision 29831 (dnet40): removed unused properties about OAI
Alessia Bardi
04:56 PM Revision 29830 (dnet40): idScheme and idNamespace are not a property anymore, but they are dynamically read from the OAI configuration profile
Alessia Bardi
03:01 PM Revision 29829 (dnet40): Better to use the info level for the interceptor, so we can see that someone is keeping on harvesting. The possible resumption token is instead printed in debug mode by DNetOAICore
Alessia Bardi
02:53 PM Revision 29828 (dnet40): OAI interceptor now logs in debug if everything's ok
Alessia Bardi
02:34 PM Revision 29827 (dnet40): introducing trust_level_threshold support in statistics workflow
Marek Horst
02:27 PM Revision 29826 (dnet40): introducing trust_level_threshold support in common import workflow
Marek Horst
02:24 PM Revision 29825 (dnet40): introducing trust level threshold support when importing information space data
Marek Horst
02:15 PM Revision 29824 (dnet40): introducing IMPORT_TRUST_LEVEL_THRESHOLD parameter
Marek Horst
01:27 PM Revision 29823 (dnet40): throwing exception when mdstoreid or mdstore service location set to $UNDEFINED$ value
Marek Horst
01:21 PM Revision 29822 (dnet40): throwing exception when actionsetid set to $UNDEFINED$ value
Marek Horst
01:13 PM Revision 29821 (dnet40): providing default value for action_set_id_entity_dataset set to $UNDEFINED$. This change is required when exporting in statistics export mode where no entities are exported and such parameter should not be required.
Marek Horst
12:57 PM Revision 29820 (dnet40): AbstractContentInitializer log to fatal
Alessia Bardi
12:56 PM Revision 29819 (dnet40): introducing dedicated statistics mainworkflow encapsulating importing, processing and exporting phases. This workflow was introduced explicitly for statistics purposes because we want to operate over InformationSpace imported data in contrary to primary workflow where some of the statistics input was inferred and it wasn't clear whether it will become part of InformationSpace.
Marek Horst
11:33 AM Revision 29818 (dnet40): extending description
Marek Horst
11:30 AM Revision 29817 (dnet40): allowing overriding inference_provenance_blacklist default 'iis' value which will be required in mainworkflows/statistcs where inferenced document to project relations should be taken into account
Marek Horst

21/08/2014

06:48 PM Revision 29816 (dnet40): setting default $undefined$ value for 'input_aux_dataset_existing_id'
Marek Horst
06:33 PM Revision 29815 (dnet40): setting default undefined values for 'mdstore_service_location' and 'dataset_mdstore_ids_csv'
Marek Horst
06:13 PM Revision 29814 (dnet40): Cleaned logs
Alessia Bardi
05:26 PM Revision 29813 (dnet40): Updated default list of compound indices.
Alessia Bardi
05:15 PM Revision 29812 (dnet40): logs pretty print dates as the IS container does
Alessia Bardi
05:01 PM Revision 29811 (dnet40): Allow "<>" in queries in OAI configuration using EscapeXML before saving to the configuration profile.
Alessia Bardi
02:03 PM Revision 29809 (dnet40): introducing shared citation ExtraData XML model in icm-iis-common, implementing citation importer in mapred_import workflow, implementing exporter module
Marek Horst
02:03 PM Revision 29808 (dnet40): introducing shared citation ExtraData XML model in icm-iis-common, implementing citation importer in mapred_import workflow, implementing exporter module
Marek Horst
02:03 PM Revision 29807 (dnet40): introducing shared citation ExtraData XML model in icm-iis-common, implementing citation importer in mapred_import workflow, implementing exporter module
Marek Horst
12:56 PM Revision 29806 (dnet40): introducing CONFIDENCE_TO_TRUST_LEVEL_FACTOR field holding 0.9 multiplier used for IIS confidence level [0;1] translation to trust level [0;0.9]
Marek Horst

20/08/2014

05:58 PM Revision 29801 (dnet40): supporting $UNDEFINED$ value in IMPORT_INFERENCE_PROVENANCE_BLACKLIST
Marek Horst

19/08/2014

12:14 PM Revision 29799 (dnet40): adding junit dependency for unit tests
Marek Horst
12:13 PM Revision 29798 (dnet40): introducing citations xstream deserialization tests
Marek Horst
12:13 PM Revision 29797 (dnet40): introducing hashCode and equals method
Marek Horst
12:00 PM Revision 29796 (dnet40): introducing CitationsXmlConverter unit test
Marek Horst

18/08/2014

05:08 PM Revision 29795 (dnet40): updating main method introduced for testing purposes
Marek Horst
05:07 PM Revision 29794 (dnet40): updating main method introduced for testing purposes
Marek Horst
05:05 PM Revision 29793 (dnet40): #433 introducing ComparableCitationEntry and TypedId model in citations, exported as sorted set XML representation
Marek Horst
 

Also available in: Atom