D-Net

#1176 defining remove_sideproducts property in workflows headers

#1176 introducing side products removal in common import by maintaining remove_sideproducts flag set to true by default.
Notice: do not provide any output directory location pointing to workingDir subdirectory!

removing duplicate collapser import and aligning worklfow definition

#1172 introducing support for active_export parameter in both preprocessing and primary workflows

updating job.properties

#1153 utilizing ${user.name} placeholder in ${workingDir} generation process, copying version.properties from oozie_app to mark execution environment with application version

#1147 introducing HTML import and HTML plaintext ingestion in main workflows: primary and preprocessing

#1147 renaming icm-iis-ingest-webcrawl module to icm-iis-ingest to make it more generic so it could contain not only webcrawl related ingesters but html ingesters as well

updating job.properties

overriding memory parameter due to test cluster memory limitations, setting it to Xmx256m