Activity
From 10/08/2014 to 08/09/2014
08/09/2014
- 06:11 PM Revision 30058 (dnet40): propagation of excepions as JSON objects
- 05:44 PM Revision 30057 (dnet40): #597 adding svn.repository,svn.path properties in version.properties file
- 05:43 PM Revision 30056 (dnet40): #614 introducing monitor profile dedicated for monitoring oozie job progress and propagating final job status as maven result. Upgrading exec-maven-plugin to 1.3.2 in order to allow dumping stdout to file which was added in deploy profile to allow job identifier extraction
- 05:19 PM Revision 30055 (dnet40): introducing oozie maven plugin required by IIS build system for monitoring oozie progress of executed job
- 05:15 PM Revision 30054 (dnet40): Share project "icm-iis-oozie-maven-plugin" into "https://svn.driver.research-infrastructures.eu/driver"
- 04:58 PM Revision 30053 (dnet40): prepare shutdown
- 04:39 PM Revision 30052 (dnet40): - Added interface and client implementation for mdstore service
- - Changes in validator to support reading from mdstores.
- 11:39 AM Revision 30049 (dnet40): updating job.properties
05/09/2014
- 06:16 PM Revision 30045 (dnet40): should fix __result field serialization
- 06:16 PM Revision 30044 (dnet40): Finalized workflow
- 06:13 PM Revision 30043 (dnet40): fixed bug with null values on result date
- 06:13 PM Revision 30042 (dnet40): fixed bug with null values on result date
- 06:07 PM Revision 30041 (dnet40): updated metadata format profile
- 06:07 PM Revision 30040 (dnet40): updated required parameters
- 06:06 PM Revision 30039 (dnet40): lookup for "solr" as backendId
- 06:05 PM Revision 30038 (dnet40): added created index node
- 05:54 PM Revision 30037 (dnet40): fixed handling of unexisting set
- 01:58 PM Revision 30033 (dnet40): Added Stoppable Interface
- 01:46 PM Revision 30032 (dnet40): release connection
- 01:43 PM Revision 30031 (dnet40): indexing wf uses the new index service specs
04/09/2014
- 11:53 PM Revision 30026 (dnet40)
- 09:27 PM Revision 30025 (dnet40)
- 09:02 PM Revision 30024 (dnet40)
- 08:57 PM Revision 30023 (dnet40)
- 08:53 PM Revision 30022 (dnet40)
- 05:51 PM Revision 30021 (dnet40): stats update moved to dedicated wf
- 05:39 PM Revision 30020 (dnet40)
- 05:38 PM Revision 30019 (dnet40): updated date format for projects
- 04:08 PM Revision 30017 (dnet40): removed CDATA from extraInfo payloads
- 04:05 PM Revision 30015 (dnet40): text labels
- 02:44 PM Revision 30009 (dnet40): Error details
- 01:10 PM Revision 30006 (dnet40): setting export_action_set_id_entity_dataset to $UNDEFINED$ by default, this should not be required because dataset reference extraction module might be deactivated. Check will be performed at dataset entity exporter module and when value is not set - exception will be raised.
- 11:44 AM Revision 30005 (dnet40): using CloudSolrServer for parallel index feeding
- 11:03 AM Revision 30003 (dnet40): added js library to use the LocalStorage
03/09/2014
- 09:42 PM Revision 30001 (dnet40)
- 09:35 PM Revision 30000 (dnet40)
- 09:34 PM Revision 29999 (dnet40)
- 09:34 PM Revision 29998 (dnet40)
- 09:28 PM Revision 29997 (dnet40)
- 09:19 PM Revision 29996 (dnet40)
- 09:10 PM Revision 29995 (dnet40)
- 07:39 PM Revision 29994 (dnet40)
- 07:33 PM Revision 29993 (dnet40)
- 07:29 PM Revision 29992 (dnet40)
- 07:28 PM Revision 29991 (dnet40)
- 07:05 PM Revision 29989 (dnet40): added flags to enable/disable metadata extraction module
- 06:32 PM Revision 29988 (dnet40): removing empty package
- 06:04 PM Revision 29987 (dnet40)
- 05:58 PM Revision 29985 (dnet40): added flags to enable/disable metadata extraction module
- 05:53 PM Revision 29982 (dnet40): #757 temporarily disabling PMC ingestion until fixing openaire identifiers building process
- 04:25 PM Revision 29981 (dnet40)
- 03:28 PM Revision 29980 (dnet40): fix-back location
- 03:28 PM Revision 29979 (dnet40): added two sample vocabularies
- 02:36 PM Revision 29978 (dnet40): Implemented reloading of index once the schema is updated
- 12:50 PM Revision 29976 (dnet40): minor fix
- 12:47 PM Revision 29975 (dnet40): implemented xquery history (max 100 elements)
- 12:44 PM Revision 29974 (dnet40): changed actions from Resource to Autowired to allow the container to start also if there is no SubscriptionAction bean defined
- 12:42 PM Revision 29973 (dnet40): implemented MDFormato Notification handler
- 12:00 PM Revision 29972 (dnet40): added action sets dedicated to each inference module
- 12:00 PM Revision 29971 (dnet40): added action sets dedicated to each inference module
- 11:55 AM Revision 29970 (dnet40): repo filter using activation api status
- 11:35 AM Revision 29969 (dnet40)
- 11:15 AM Revision 29968 (dnet40): introduced a check for NaN in TMGeo.xsl
- 11:04 AM Revision 29967 (dnet40): #568, #577 enabling proper citations export by introducing PMC citation ingestion and citation matching outcome merging and grouping for exporting purposes. Introducing union instead of collapser which should be introduced in near future.
- 10:46 AM Revision 29966 (dnet40): updated jobs specs
- 10:40 AM Revision 29965 (dnet40): aligned parameters with job specs
- 10:00 AM Revision 29964 (dnet40): this container uses a branch index service with SOLR embedded 4.3.1
- 09:57 AM Revision 29963 (dnet40): fixed path to cleaning scriptts in WF
- 09:56 AM Revision 29962 (dnet40): uris cleaning scripts
- 09:44 AM Revision 29961 (dnet40): sticking to solr 4.7.0 for code executed on the hadoop cluster, until java 1.7 won't be available
- 12:48 AM Revision 29960 (dnet40)
02/09/2014
- 10:31 PM Revision 29959 (dnet40)
- 10:28 PM Revision 29958 (dnet40)
- 10:27 PM Revision 29957 (dnet40)
- 07:15 PM Revision 29956 (dnet40): picked updated implementation from cnr-index-solr-common
- 06:50 PM Revision 29955 (dnet40): updated IIS specific property
- 06:27 PM Revision 29954 (dnet40): Added multivalued="false" when needed on organisations, datasources and persons.
- 06:09 PM Revision 29953 (dnet40): added multivalued="false" for fields needed for sorting
- 06:01 PM Revision 29952 (dnet40): added integration
- 05:59 PM Revision 29951 (dnet40): added files
- 05:58 PM Revision 29950 (dnet40): moved in the right folder
- 05:57 PM Revision 29949 (dnet40): added trunk
- 05:57 PM Revision 29948 (dnet40): created dnet-data container
- 05:23 PM Revision 29946 (dnet40): added branch name
- 05:22 PM Revision 29945 (dnet40): updated param name and values
- 05:13 PM Revision 29944 (dnet40): updated xpath for text selection
- 05:12 PM Revision 29943 (dnet40): updated G.Bodard scripts
- 05:07 PM Revision 29942 (dnet40): fixed schema value
- 03:32 PM Revision 29938 (dnet40): branch of cnr-solr-index-service working with solr 4.3.1 fixed version.
- 03:29 PM Revision 29937 (dnet40): this branch uses solr 4.3.1 instead of dnet-parent property apache.solr.version being equal to 4.9
- 02:49 PM Revision 29936 (dnet40): removing memory related properties, fixing #757 should solve all memory related problems
- 02:12 PM Revision 29935 (dnet40): added note for Zenodo when the institution cannot be found in our db. Fixing part of #745
- 01:22 PM Revision 29934 (dnet40): Fixed bug with datatasource to hbase wf
- 01:22 PM Revision 29933 (dnet40): Added node to launch generic sql commands
- Use of alternative methods for sql queries
- 12:27 PM Revision 29932 (dnet40): updated port number
- 12:11 PM Revision 29931 (dnet40)
- 12:01 PM Revision 29930 (dnet40)
- 11:43 AM Revision 29929 (dnet40)
- 11:42 AM Revision 29928 (dnet40)
- 11:02 AM Revision 29927 (dnet40): fix a rendering bug
- 10:41 AM Revision 29926 (dnet40)
- 10:06 AM Revision 29924 (dnet40): set hbase dir to props
01/09/2014
- 11:15 PM Revision 29922 (dnet40)
- 05:39 PM Revision 29921 (dnet40): update in dependencies
- 03:34 PM Revision 29920 (dnet40): cache invalidation when compliance is updated
- 03:28 PM Revision 29919 (dnet40): xquery performance
- 12:31 PM Revision 29918 (dnet40): added oozie endpoint for DM cluster@ICM
- 12:25 PM Revision 29917 (dnet40): updated provision wf
29/08/2014
- 06:29 PM Revision 29914 (dnet40): #568 introducing citations grouping by sourceDocumentId, still to be adjusted for ingested pmc citations outcome which currently seems to hang up
- 06:25 PM Revision 29913 (dnet40): fixing NPEx
- 06:06 PM Revision 29912 (dnet40): removed unused total value
- 04:42 PM Revision 29911 (dnet40): updated wf definition
- 04:27 PM Revision 29910 (dnet40): reused wf definitions instead of dubling them in a dedicated load wf
- 11:53 AM Revision 29906 (dnet40): #577 introducing UDF producing empty map, two transformers building common Citation datastore from citationmatching and pmc ingestion outcome. Both are required by collapser.
- 10:57 AM Revision 29905 (dnet40): updated branch version and build scripts
- 10:57 AM Revision 29904 (dnet40): minor fix
- 10:50 AM Revision 29903 (dnet40): update branch with contributes from trunk and other branches
28/08/2014
- 08:30 PM Revision 29902 (dnet40): setting confidence level to 1*factor when not specified
- 08:28 PM Revision 29901 (dnet40): removing redundant code
- 08:23 PM Revision 29900 (dnet40): #577 updating Citation namespace
- 07:24 PM Revision 29899 (dnet40): #577 introducing common.citations.Citation schema
- 06:34 PM Revision 29898 (dnet40): #597 reintroducing changes supplemented with org.tmatesoft.svnkit:svnkit:1.8.5 explicitly defined depedency
- 06:16 PM Revision 29897 (dnet40): #597 reverting svn version related changes until resolving 1.8 svn client issues
- 04:51 PM Revision 29896 (dnet40): refactoring of the repoUI homepage
- 04:32 PM Revision 29895 (dnet40): updating expected output
- 02:35 PM Revision 29894 (dnet40): 3rd round of fixes due to Europeana feedback
- 01:38 PM Revision 29893 (dnet40): removing output_citation_pmc port duplicate
- 11:40 AM Revision 29892 (dnet40): fixed a problem with an ajax call
- 11:06 AM Revision 29891 (dnet40): aligned with solr 4.9
- 11:05 AM Revision 29890 (dnet40): bumped solr version
- 11:04 AM Revision 29889 (dnet40): http post header
- 10:57 AM Revision 29888 (dnet40)
27/08/2014
- 05:59 PM Revision 29887 (dnet40): 2nd round of fixes due to Europeana feedback
- 05:41 PM Revision 29886 (dnet40): use of the extrafield that overrides the api compliance for the creation of the hbase datasource records
- 04:42 PM Revision 29885 (dnet40): minor fix
- 04:33 PM Revision 29884 (dnet40): use of an extrafield to override the api compliance
- 12:48 PM Revision 29883 (dnet40): expected record updated
- 12:42 PM Revision 29882 (dnet40): #597 deploying svn version in oozie_app/version.properties file
- 12:03 PM Revision 29881 (dnet40): - extrafields management
- - added a method to override the compliance
- 11:43 AM Revision 29880 (dnet40): removing redundant ReferenceBasicMetadata and ReferenceMetadata definitions which are also available in standalone avdl definitions, replacing definitions with import statements.
- 11:24 AM Revision 29879 (dnet40): minor fix
- 11:16 AM Revision 29878 (dnet40): updated finalize node
26/08/2014
- 06:47 PM Revision 29876 (dnet40): Updated documentation to state which fields is applicable only to datasets or only to publications (see #744 and Result.proto)
- 06:13 PM Revision 29875 (dnet40): base query set for OAI export
- 05:29 PM Revision 29874 (dnet40): changed dependency from cnr-enabling-services to cnr-service-common
- 05:29 PM Revision 29873 (dnet40): added params to solrconfig: ramBufferSizeMB, mergeFactor, termIndexInterval
- 04:48 PM Revision 29872 (dnet40): changed to pending
- 04:35 PM Revision 29871 (dnet40): prepending labels giving context to vocabulary terms
- 04:19 PM Revision 29870 (dnet40)
- 04:03 PM Revision 29869 (dnet40): first round of fixes due to Europeana feedback
- 03:44 PM Revision 29868 (dnet40): See ticket #708: 'file::hybrid' term is missing from 'D-Net Content Description Typologies' vocabulary
- 02:58 PM Revision 29867 (dnet40): added some log debug
- 02:39 PM Revision 29866 (dnet40): fixed IPR for images
- 12:14 PM Revision 29865 (dnet40): force default general ipr statement
- 12:08 PM Revision 29864 (dnet40): forced module to be compiled with java 6
- 11:47 AM Revision 29863 (dnet40)
- 11:32 AM Revision 29862 (dnet40): added property prefixes
- 11:30 AM Revision 29861 (dnet40): added m/r specific properties
- 11:14 AM Revision 29860 (dnet40): changed properties passed to index feed m/r job
- 11:09 AM Revision 29859 (dnet40): added solr webContext
- 10:32 AM Revision 29858 (dnet40): fixed pom and scripts
- 10:31 AM Revision 29857 (dnet40): branch to test the new index feeding libs
25/08/2014
- 06:15 PM Revision 29856 (dnet40): updated index feed job to make use of the new shared solr lib
- 06:09 PM Revision 29855 (dnet40): updating performance test
- 06:06 PM Revision 29854 (dnet40): moving ACM importer to icm-iis-mainworkflows due to extending dependances with cermine, introducing performance tests
- 06:06 PM Revision 29853 (dnet40): moving ACM importer to icm-iis-mainworkflows due to extending dependances with cermine, introducing performance tests
- 05:33 PM Revision 29852 (dnet40): removed deploy info
- 05:33 PM Revision 29851 (dnet40): added deploy info
- 05:31 PM Revision 29850 (dnet40): branch to test the new index feeding libs
- 05:29 PM Revision 29849 (dnet40): moved StreamingInputDocumentFactory to dnet-index-solr-common
- 04:53 PM Revision 29848 (dnet40): show the current size when current > total
- 04:46 PM Revision 29847 (dnet40): moved dependency to solr from dnet-index-client to dnet-index-solr-client
- 04:45 PM Revision 29846 (dnet40): removed dependency to solr
- 04:22 PM Revision 29845 (dnet40): Show of inaccurate size in progressJobNode
- 04:13 PM Revision 29844 (dnet40): added ignore property
- 04:11 PM Revision 29843 (dnet40): added standard maven folder
- 04:07 PM Revision 29842 (dnet40): added pom
- 03:57 PM Revision 29841 (dnet40): added trunk
- 03:57 PM Revision 29840 (dnet40): create module dnet-index-solr-common
- 02:14 PM Revision 29839 (dnet40): convertBibEntry() made public
- 12:56 PM Revision 29837 (dnet40): New examples in the docsim demonstrator, matching the new database content
- 12:55 PM Revision 29836 (dnet40): updating default job properties
22/08/2014
- 05:38 PM Revision 29835 (dnet40): removing common import input parameters which are not required in this context
- 05:34 PM Revision 29834 (dnet40): removing 'import' directory creation and removal which was obsolete
- 05:27 PM Revision 29833 (dnet40): checking whether trust level is empty before comparing to predefined threshold
- 04:57 PM Revision 29831 (dnet40): removed unused properties about OAI
- 04:56 PM Revision 29830 (dnet40): idScheme and idNamespace are not a property anymore, but they are dynamically read from the OAI configuration profile
- 03:01 PM Revision 29829 (dnet40): Better to use the info level for the interceptor, so we can see that someone is keeping on harvesting. The possible resumption token is instead printed in debug mode by DNetOAICore
- 02:53 PM Revision 29828 (dnet40): OAI interceptor now logs in debug if everything's ok
- 02:34 PM Revision 29827 (dnet40): introducing trust_level_threshold support in statistics workflow
- 02:27 PM Revision 29826 (dnet40): introducing trust_level_threshold support in common import workflow
- 02:24 PM Revision 29825 (dnet40): introducing trust level threshold support when importing information space data
- 02:15 PM Revision 29824 (dnet40): introducing IMPORT_TRUST_LEVEL_THRESHOLD parameter
- 01:27 PM Revision 29823 (dnet40): throwing exception when mdstoreid or mdstore service location set to $UNDEFINED$ value
- 01:21 PM Revision 29822 (dnet40): throwing exception when actionsetid set to $UNDEFINED$ value
- 01:13 PM Revision 29821 (dnet40): providing default value for action_set_id_entity_dataset set to $UNDEFINED$. This change is required when exporting in statistics export mode where no entities are exported and such parameter should not be required.
- 12:57 PM Revision 29820 (dnet40): AbstractContentInitializer log to fatal
- 12:56 PM Revision 29819 (dnet40): introducing dedicated statistics mainworkflow encapsulating importing, processing and exporting phases. This workflow was introduced explicitly for statistics purposes because we want to operate over InformationSpace imported data in contrary to primary workflow where some of the statistics input was inferred and it wasn't clear whether it will become part of InformationSpace.
- 11:33 AM Revision 29818 (dnet40): extending description
- 11:30 AM Revision 29817 (dnet40): allowing overriding inference_provenance_blacklist default 'iis' value which will be required in mainworkflows/statistcs where inferenced document to project relations should be taken into account
21/08/2014
- 06:48 PM Revision 29816 (dnet40): setting default $undefined$ value for 'input_aux_dataset_existing_id'
- 06:33 PM Revision 29815 (dnet40): setting default undefined values for 'mdstore_service_location' and 'dataset_mdstore_ids_csv'
- 06:13 PM Revision 29814 (dnet40): Cleaned logs
- 05:26 PM Revision 29813 (dnet40): Updated default list of compound indices.
- 05:15 PM Revision 29812 (dnet40): logs pretty print dates as the IS container does
- 05:01 PM Revision 29811 (dnet40): Allow "<>" in queries in OAI configuration using EscapeXML before saving to the configuration profile.
- 02:03 PM Revision 29809 (dnet40): introducing shared citation ExtraData XML model in icm-iis-common, implementing citation importer in mapred_import workflow, implementing exporter module
- 02:03 PM Revision 29808 (dnet40): introducing shared citation ExtraData XML model in icm-iis-common, implementing citation importer in mapred_import workflow, implementing exporter module
- 02:03 PM Revision 29807 (dnet40): introducing shared citation ExtraData XML model in icm-iis-common, implementing citation importer in mapred_import workflow, implementing exporter module
- 12:56 PM Revision 29806 (dnet40): introducing CONFIDENCE_TO_TRUST_LEVEL_FACTOR field holding 0.9 multiplier used for IIS confidence level [0;1] translation to trust level [0;0.9]
20/08/2014
- 05:58 PM Revision 29801 (dnet40): supporting $UNDEFINED$ value in IMPORT_INFERENCE_PROVENANCE_BLACKLIST
19/08/2014
- 12:14 PM Revision 29799 (dnet40): adding junit dependency for unit tests
- 12:13 PM Revision 29798 (dnet40): introducing citations xstream deserialization tests
- 12:13 PM Revision 29797 (dnet40): introducing hashCode and equals method
- 12:00 PM Revision 29796 (dnet40): introducing CitationsXmlConverter unit test
18/08/2014
- 05:08 PM Revision 29795 (dnet40): updating main method introduced for testing purposes
- 05:07 PM Revision 29794 (dnet40): updating main method introduced for testing purposes
- 05:05 PM Revision 29793 (dnet40): #433 introducing ComparableCitationEntry and TypedId model in citations, exported as sorted set XML representation
Also available in: Atom