A B C D E F G H I J K L M N O P Q R S T U V W X Z 
All Classes All Packages

A

ACCEPT - de.pangaea.metadataportal.config.FilterConfig.FilterType
 
add(String) - Method in class de.pangaea.metadataportal.utils.HugeStringHashBuilder
Adds a String
add(String, Object) - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
 
add(String, Object...) - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
 
addAlias(String, String) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
Adds alias to index.
addDocument(MetadataDocument) - Method in class de.pangaea.metadataportal.harvester.Harvester
Adds a document to the Harvester.processor working in the background.
addDocument(MetadataDocument) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
addDocument(MetadataDocument) - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
 
addDocument(MetadataDocument) - Method in class de.pangaea.metadataportal.processor.DocumentProcessor
 
addDocument(String, long, Source) - Method in class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
Adds a document to the Harvester.processor working in the background.
addDocument(String, Instant, Source) - Method in class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
Adds a document to the Harvester.processor working in the background.
addDocument(String, Instant, Source) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 
addDoNothing(String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Adds a dummy rule for element paths, that are allowed, but not parsed.
addEsAddress(String) - Method in class de.pangaea.metadataportal.config.Config
Deprecated.
addField(FieldConfig) - Method in class de.pangaea.metadataportal.config.Config
 
addField(KeyValuePairs, FieldConfig, String) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Helper method to add a field in the correct format to given XContentBuilder.
addFields(KeyValuePairs) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Helper method that adds all fields to the given XContentBuilder instance.
addFilter(FilterConfig) - Method in class de.pangaea.metadataportal.config.Config
 
addGlobalHarvesterProperty(String) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
Deprecated.
addHarvester(HarvesterConfig) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
Adds harvester.
addHarvesterProperty(String) - Method in class de.pangaea.metadataportal.config.HarvesterConfig
Deprecated.
addSet(String) - Method in class de.pangaea.metadataportal.harvester.OAIMetadataDocument
Adds an OAI set to the set Set.
addSystemVariables(Map<QName, Object>) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Helper method to register all standard variables for the XPath/Templates evaluation.
addTargetIndex(TargetIndexConfig) - Method in class de.pangaea.metadataportal.config.Config
 
addVariable(VariableConfig) - Method in class de.pangaea.metadataportal.config.Config
 
aliases - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
 
ATTRIBUTE_ELEMENT_PREFIX - Static variable in class de.pangaea.metadataportal.utils.XMLToKeyValuePairs
If an element has a local name with this prefix, it is converted to a JSON attribute, prefixed by @.
authorizationHeader - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
the authorizationHeader from configuration

B

BackgroundFailure - Exception in de.pangaea.metadataportal.processor
DocumentProcessor throws this exception, if an error occurs in the processing threads.
BackgroundFailure(Throwable) - Constructor for exception de.pangaea.metadataportal.processor.BackgroundFailure
 
BASE_VARIABLES - Static variable in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
begin(String, String, Attributes) - Method in class de.pangaea.metadataportal.harvester.OAIMetadataSaxRule
 
begin(String, String, Attributes) - Method in class de.pangaea.metadataportal.utils.ElementNameCallParamRule
 
begin(String, String, Attributes) - Method in class de.pangaea.metadataportal.utils.SaxRule
 
BOOLEAN - de.pangaea.metadataportal.config.FieldConfig.DataType
 
BooleanParser - Class in de.pangaea.metadataportal.utils
BooleanParser is a simple static class supplying a method to parse booleans.
build() - Method in class de.pangaea.metadataportal.utils.HugeStringHashBuilder
Builds a read only set.
buildDocumentAction(MetadataDocument) - Method in class de.pangaea.metadataportal.processor.DocumentProcessor
Processes the given MetadataDocument and returns the DocWriteRequest to pass to Elasticsearch (can either be IndexRequest or DeleteRequest).

C

cancelMissingDocumentDelete() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
Disable the property "deleteMissingDocuments" for this instance.
cancelMissingDocumentDelete() - Method in class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
disable the property "deleteMissingDocuments" for this instance.
characters(char[], int, int) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
 
check() - Method in class de.pangaea.metadataportal.config.HarvesterConfig
Checks, if configuration is ok.
check() - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
Checks, if configuration is ok.
checked - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
 
clear() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
 
client() - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
 
close() - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
 
close() - Method in class de.pangaea.metadataportal.processor.MinimalTransportClient
 
close() - Method in class de.pangaea.metadataportal.utils.NoCloseInputStream
 
close(boolean) - Method in class de.pangaea.metadataportal.harvester.ElasticsearchHarvester
 
close(boolean) - Method in class de.pangaea.metadataportal.harvester.Harvester
Closes harvester.
close(boolean) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
 
close(boolean) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
close(boolean) - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
 
close(boolean) - Method in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
 
close(boolean) - Method in class de.pangaea.metadataportal.harvester.Rebuilder
 
close(boolean) - Method in class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
 
close(Set<String>) - Method in class de.pangaea.metadataportal.processor.DocumentProcessor
 
closeIndex(TargetIndexConfig, String, boolean) - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
Closes the index after harvesting and update the aliases to point to the active index.
commitAndClose() - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 
Config - Class in de.pangaea.metadataportal.config
Main panFMP configuration class.
Config(String) - Constructor for class de.pangaea.metadataportal.config.Config
 
Config(Path) - Constructor for class de.pangaea.metadataportal.config.Config
 
convertChilds(Node) - Method in class de.pangaea.metadataportal.utils.XMLToKeyValuePairs
Convert all children of a node: It first checks if all child nodes are text-only, in that case the whole node is returned as String (using Node.getTextContent().
createEmptyKeyValuePairs() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Helper method that generates an empty XContentBuilder instance.
createIndex(TargetIndexConfig, boolean) - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
Creates the index (if needed), configures it (mapping), and creates aliases.
createMetadataDocumentInstance() - Method in class de.pangaea.metadataportal.harvester.Harvester
Creates an instance of MetadataDocument and initializes it with the harvester config.
createMetadataDocumentInstance() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
createMetadataDocumentInstance() - Method in class de.pangaea.metadataportal.harvester.Rebuilder
 
createMetadataDocumentInstance() - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 
currentNamespaceMap - Variable in class de.pangaea.metadataportal.utils.ExtendedDigester
 
custContentHandler - Variable in class de.pangaea.metadataportal.utils.ExtendedDigester
 

D

datatype - Variable in class de.pangaea.metadataportal.config.FieldConfig
 
datestamp - Variable in class de.pangaea.metadataportal.processor.MetadataDocument
 
DATETIME - de.pangaea.metadataportal.config.FieldConfig.DataType
 
dbf - Static variable in class de.pangaea.metadataportal.utils.StaticFactories
 
de.pangaea.metadataportal - package de.pangaea.metadataportal
This is the root package of panFMP.
de.pangaea.metadataportal.config - package de.pangaea.metadataportal.config
This package provides classes and methods for panFMP's configuration (config.xml).
de.pangaea.metadataportal.harvester - package de.pangaea.metadataportal.harvester
This package provides panFMP's harvesters and their corresponding classes.
de.pangaea.metadataportal.processor - package de.pangaea.metadataportal.processor
This package provides panFMP's document processor (used to parse and transform documents for indexing with Elasticsearch) and corresponding classes.
de.pangaea.metadataportal.push - package de.pangaea.metadataportal.push
This package contains a simple HTTP server to push XML documents to index panFMP.
de.pangaea.metadataportal.utils - package de.pangaea.metadataportal.utils
This package provides utility classes for panFMP.
DEFAULT_BULK_MEMORY - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
 
DEFAULT_BULK_SIZE - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
 
DEFAULT_CONCURRENT_BULK_REQUESTS - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
 
DEFAULT_CONTENT_TYPE - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
 
DEFAULT_DELETE_UNSEEN_BULK_SIZE - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
 
DEFAULT_MAX_QUEUE - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
 
DEFAULT_NUM_THREADS - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
 
DEFAULT_RETRY_COUNT - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
DEFAULT_RETRY_COUNT - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
 
DEFAULT_RETRY_COUNT - Static variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
 
DEFAULT_RETRY_TIME - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
DEFAULT_RETRY_TIME - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
 
DEFAULT_RETRY_TIME - Static variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
 
DEFAULT_TIMEOUT - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
DEFAULT_TIMEOUT - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
 
DEFAULT_TIMEOUT - Static variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
 
defaultValue - Variable in class de.pangaea.metadataportal.config.FieldConfig
 
deleted - Variable in class de.pangaea.metadataportal.processor.MetadataDocument
 
deleteDocument(String) - Method in class de.pangaea.metadataportal.harvester.Harvester
Queues the given ID for deletion.
deleteDocument(String) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 
DELETEDOCUMENT - de.pangaea.metadataportal.processor.DocumentErrorAction
 
deleteMissingDocuments - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
If enabled, on any kind of full harvesting it will track all valid identifiers and delete all of them not seen in index.
DENY - de.pangaea.metadataportal.config.FilterConfig.FilterType
 
destContentHandler - Variable in class de.pangaea.metadataportal.utils.SaxRule
 
DirectoryHarvester - Class in de.pangaea.metadataportal.harvester
Harvester for traversing file system directories.
DirectoryHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.DirectoryHarvester
 
DOCUMENT_PROCESSOR_NAMESPACE - Static variable in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
DocumentErrorAction - Enum in de.pangaea.metadataportal.processor
Enumeration that specifies what action should be taken on a document error.
DocumentProcessor - Class in de.pangaea.metadataportal.processor
Component of panFMP that analyzes and indexes harvested documents in a thread pool.
doError(String, String) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
Deprecated.
dombuilder - Static variable in class de.pangaea.metadataportal.utils.StaticFactories
 
DoNothingRule() - Constructor for class de.pangaea.metadataportal.utils.ExtendedDigester.DoNothingRule
 
doParse(Supplier<ExtendedDigester>, String, AtomicReference<Instant>) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
Harvests a URL using the suplied digester.

E

ELASTICSEARCH_DEFAULT_PORT - Static variable in class de.pangaea.metadataportal.processor.ElasticsearchConnection
 
ElasticsearchConnection - Class in de.pangaea.metadataportal.processor
TODO
ElasticsearchConnection(Config) - Constructor for class de.pangaea.metadataportal.processor.ElasticsearchConnection
 
ElasticsearchHarvester - Class in de.pangaea.metadataportal.harvester
TODO
ElasticsearchHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.ElasticsearchHarvester
 
ElementNameCallParamRule - Class in de.pangaea.metadataportal.utils
Similar to digester's PathCallParamRule, but puts only the element name of the match onto the parameter stack.
ElementNameCallParamRule(int) - Constructor for class de.pangaea.metadataportal.utils.ElementNameCallParamRule
 
emptyRule() - Static method in class de.pangaea.metadataportal.utils.SaxRule
Creates an empty "useless" SaxRule.
enableMissingDocumentDelete() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
Enable unseen document deletes.
end(String, String) - Method in class de.pangaea.metadataportal.harvester.OAIMetadataSaxRule
 
end(String, String) - Method in class de.pangaea.metadataportal.utils.SaxRule
 
endElement(String, String, String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
 
endPrefixMapping(String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.DirectoryHarvester
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.ElasticsearchHarvester
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.Harvester
This method is used by subclasses to enumerate all available harvester properties that are implemented by them.
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.Rebuilder
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.harvester.ZipFileHarvester
 
enumerateValidHarvesterPropertyNames(Set<String>) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 
error(TransformerException) - Method in class de.pangaea.metadataportal.utils.LoggingErrorListener
Just throws e.
error(SAXParseException) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Just throws ex.
esMapping - Variable in class de.pangaea.metadataportal.config.Config
 
esMappingFile - Variable in class de.pangaea.metadataportal.config.Config
 
esSettings - Variable in class de.pangaea.metadataportal.config.Config
 
esTransports - Variable in class de.pangaea.metadataportal.config.Config
 
evaluateTemplate(ExpressionConfig) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Helper method to evaluate a template.
evaluateTemplateAsXHTML(FieldConfig) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Helper method to evaluate a template and return result as XHTML.
excludeNamespaces - Variable in class de.pangaea.metadataportal.utils.SaxRule
 
ExpressionConfig - Class in de.pangaea.metadataportal.config
Generic XPath/XSLT config element.
ExpressionConfig() - Constructor for class de.pangaea.metadataportal.config.ExpressionConfig
 
ExtendedDigester - Class in de.pangaea.metadataportal.utils
Extension of the Commons Digester Class, that works around some limitations/bugs.
ExtendedDigester() - Constructor for class de.pangaea.metadataportal.utils.ExtendedDigester
 
ExtendedDigester.DoNothingRule - Class in de.pangaea.metadataportal.utils
This rule does nothing.

F

fatalError(TransformerException) - Method in class de.pangaea.metadataportal.utils.LoggingErrorListener
Just throws e.
fatalError(SAXParseException) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Just throws ex.
FieldConfig - Class in de.pangaea.metadataportal.config
Config element that contains the definition of a field.
FieldConfig() - Constructor for class de.pangaea.metadataportal.config.FieldConfig
 
FieldConfig.DataType - Enum in de.pangaea.metadataportal.config
 
FIELDNAME_CONTENT - Static variable in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
 
FIELDNAME_DATESTAMP - Static variable in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
 
FIELDNAME_IDENTIFIER - Static variable in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
 
FIELDNAME_XML - Static variable in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
 
fieldnameDatestamp - Variable in class de.pangaea.metadataportal.config.Config
 
fieldnameSource - Variable in class de.pangaea.metadataportal.config.Config
 
fieldnameXML - Variable in class de.pangaea.metadataportal.config.Config
 
fields - Variable in class de.pangaea.metadataportal.config.Config
 
file - Variable in class de.pangaea.metadataportal.config.Config
 
FilterConfig - Class in de.pangaea.metadataportal.config
A filter config element that filters harvested documents by a XPath expression that returns a XPathConstants.BOOLEAN value.
FilterConfig() - Constructor for class de.pangaea.metadataportal.config.FilterConfig
 
FilterConfig.FilterType - Enum in de.pangaea.metadataportal.config
 
filterDefault - Variable in class de.pangaea.metadataportal.config.Config
 
filterIncomingSets - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
The harvester should filter incoming documents according to its set metadata.
filters - Variable in class de.pangaea.metadataportal.config.Config
 
finalizeKeyValuePairs(KeyValuePairs) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Helper method that finalizes the JSON document
finishDocument() - Method in class de.pangaea.metadataportal.utils.SaxRule
Closes the elements created in initDocument().
finishReindex(boolean) - Method in class de.pangaea.metadataportal.harvester.Harvester
Does cleanup work after rebuilding the index by Rebuilder.
finishReindex(boolean) - Method in class de.pangaea.metadataportal.harvester.Rebuilder
 
finishReindex(boolean) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 
finishTransformation() - Method in class de.pangaea.metadataportal.processor.MetadataDocument.XMLConverter
 
formatElasticsearch(TemporalAccessor) - Static method in class de.pangaea.metadataportal.utils.ISODateFormatter
Formats an Elasticsearch date.
formatOAIDate(TemporalAccessor, boolean) - Static method in class de.pangaea.metadataportal.utils.ISODateFormatter
Formats an ISO date, according to the OAI granularity.
fromDateReference - Variable in class de.pangaea.metadataportal.harvester.Harvester
Date from which should be harvested (in time reference of the original server)

G

get() - Static method in class de.pangaea.metadataportal.Package
Gets package object from classloader.
getCause() - Method in exception de.pangaea.metadataportal.harvester.RetryAfterIOException
 
getCode() - Method in exception de.pangaea.metadataportal.harvester.OAIException
 
getContentHandler() - Method in class de.pangaea.metadataportal.utils.SaxRule
return the current ContentHandler.
getConverter() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Returns a converter instance that does transformation and validation according to index config.
getCurrentAssignedPrefixes() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Returns all current namespace prefix that are assigned.
getCurrentNamespaceContext(boolean, boolean) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Returns the current NamespaceContext for compiling XPath expressions.
getCurrentNamespaceForPrefix(String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Returns the current namespace URI for the given prefix.
getCurrentNamespaceMap() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Returns the current namespace prefix mappings as modifiable Map containing the prefix and the current namespace assignment (it is just a copy of the internal representation's current mapping).
getCurrentVariableMap() - Method in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
getCustomContentHandler() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Gets the custom event handler.
getDatestamp() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
 
getDebugStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
Returns a PrintStream that logs all output with DEBUG method to the given Commons Logging logger.
getDecompressingInputStream(HttpResponse<InputStream>) - Static method in class de.pangaea.metadataportal.utils.HttpClientUtils
Returns an InputStream which decodes with header "Content-Encoding"
getDefault() - Method in class de.pangaea.metadataportal.config.FieldConfig
 
getDocumentProcessor(HarvesterConfig, String) - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
 
getEntityResolver(EntityResolver) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
getErrorHandler() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Not supported, always returns null
getErrorStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
Returns a PrintStream that logs all output with ERROR method to the given Commons Logging logger.
getFatalStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
Returns a PrintStream that logs all output with FATAL method to the given Commons Logging logger.
getFinalDOM() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Returns XML contents as DOM tree.
getFullPackageDescription() - Static method in class de.pangaea.metadataportal.Package
Gets a version string to print out.
getIdentifier() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
 
getInfoStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
Returns a PrintStream that logs all output with INFO method to the given Commons Logging logger.
getInputSource(URI, AtomicReference<Instant>) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
Returns a SAX InputSource for retrieving stream data of an URL.
getInstance() - Static method in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
getKeyValuePairs() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Converts this instance to a Elasticsearch JSON node
getMessage() - Method in exception de.pangaea.metadataportal.harvester.OAIException
 
getMetadataDocumentFactory() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
Returns a factory for creating the MetadataDocuments in Digester code (using FactoryCreateRule).
getName() - Method in class de.pangaea.metadataportal.config.FieldConfig
 
getProductName() - Static method in class de.pangaea.metadataportal.Package
Gets product name ("panFMP").
getProductVendor() - Static method in class de.pangaea.metadataportal.Package
Gets product vendor (the developer team).
getRawIndexName(boolean) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
 
getRetryAfter() - Method in exception de.pangaea.metadataportal.harvester.RetryAfterIOException
 
getSets() - Method in class de.pangaea.metadataportal.harvester.OAIMetadataDocument
Returns all OAI sets as Set.
getTraceStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
Returns a PrintStream that logs all output with TRACE method to the given Commons Logging logger.
getTransformContentHandler() - Method in class de.pangaea.metadataportal.processor.MetadataDocument.XMLConverter
 
getValidHarvesterPropertyNames() - Method in class de.pangaea.metadataportal.harvester.Harvester
Return the Set of harvester property names that this harvester supports.
getVersion() - Static method in class de.pangaea.metadataportal.Package
Gets version of panFMP.
getWarnStream(Log) - Static method in class de.pangaea.metadataportal.utils.LogUtil
Returns a PrintStream that logs all output with WARN method to the given Commons Logging logger.
getXML() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Returns XML contents as String (a cache is used).
globalHarvesterProperties - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
 

H

haltOnSchemaError - Variable in class de.pangaea.metadataportal.config.Config
 
harvest() - Method in class de.pangaea.metadataportal.harvester.DirectoryHarvester
 
harvest() - Method in class de.pangaea.metadataportal.harvester.ElasticsearchHarvester
 
harvest() - Method in class de.pangaea.metadataportal.harvester.Harvester
harvest() - Method in class de.pangaea.metadataportal.harvester.NoOpHarvester
 
harvest() - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
 
harvest() - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
 
harvest() - Method in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
 
harvest() - Method in class de.pangaea.metadataportal.harvester.Rebuilder
 
harvest() - Method in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
 
harvest() - Method in class de.pangaea.metadataportal.harvester.ZipFileHarvester
 
harvest() - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 
harvestCount - Variable in class de.pangaea.metadataportal.harvester.Harvester
Count of harvested documents.
Harvester - Class in de.pangaea.metadataportal.harvester
Harvester interface to panFMP.
Harvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.Harvester
Default constructor.
HARVESTER_METADATA_FIELD_LAST_HARVESTED - Static variable in class de.pangaea.metadataportal.harvester.Harvester
 
HARVESTER_METADATA_TYPE - Static variable in class de.pangaea.metadataportal.processor.DocumentProcessor
 
harvesterClass - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
 
HarvesterConfig - Class in de.pangaea.metadataportal.config
Configuration of a panFMP harvester.
HarvesterConfig(Config, TargetIndexConfig, String) - Constructor for class de.pangaea.metadataportal.config.HarvesterConfig
Default constructor
harvesterMetadata - Variable in class de.pangaea.metadataportal.processor.DocumentProcessor
 
harvesters - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
 
harvestersAndIndexes - Variable in class de.pangaea.metadataportal.config.Config
 
harvestMessageStep - Variable in class de.pangaea.metadataportal.harvester.Harvester
HostAndPort - Class in de.pangaea.metadataportal.utils
Simple static class to parse host:port combinations.
HTML_CONTENT_TYPES - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
 
HTML_SAX_PARSER_CLASS - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
This is the parser class used to parse HTML documents to collect URLs for crawling.
httpClient - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
HttpClient to use, configured with correct connect timeout.
HttpClientUtils - Class in de.pangaea.metadataportal.utils
Some utility methods for decompressing HttpResponse
HugeStringHashBuilder - Class in de.pangaea.metadataportal.utils
A utility class that uses Lucene's BytesRefHash to create a Set.
HugeStringHashBuilder() - Constructor for class de.pangaea.metadataportal.utils.HugeStringHashBuilder
 

I

iconfig - Variable in class de.pangaea.metadataportal.harvester.Harvester
Harvester configuration
iconfig - Variable in class de.pangaea.metadataportal.processor.MetadataDocument
The harvester configuration.
id - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
 
identifier - Variable in class de.pangaea.metadataportal.processor.MetadataDocument
 
identifierPrefix - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
prepend all identifiers returned by OAI with this string
ignorableWhitespace(char[], int, int) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
 
ignoreDatestamps - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
If enabled, does full harvesting, while ignoring all datestamps (default is false).
IGNOREDOCUMENT - de.pangaea.metadataportal.processor.DocumentErrorAction
 
indexName - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
 
indexSettings - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
 
initDocument() - Method in class de.pangaea.metadataportal.utils.SaxRule
Add some elements when document started.
initializeWrapper(Config, String, Consumer<PushWrapperHarvester>) - Static method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 
initVariables() - Method in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
INTEGER - de.pangaea.metadataportal.config.FieldConfig.DataType
 
isAllIndexes(String) - Static method in class de.pangaea.metadataportal.harvester.Harvester
 
isClosed() - Method in class de.pangaea.metadataportal.harvester.Harvester
Checks if harvester is closed.
isClosed() - Method in class de.pangaea.metadataportal.processor.DocumentProcessor
 
isDeleted() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Returns deletion status.
isDocumentOutdated(Instant) - Method in class de.pangaea.metadataportal.harvester.Harvester
Checks, if the supplied Datestamp needs harvesting.
isEmpty() - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
 
isEnabled() - Method in class de.pangaea.metadataportal.harvester.OAIMetadataSaxRule
 
isFailed() - Method in class de.pangaea.metadataportal.processor.DocumentProcessor
 
ISODateFormatter - Class in de.pangaea.metadataportal.utils
Simple static class to create and parse ISO-8601 date stamps (used by OAI harvester): The used date formats are: Long date: uuuu-MM-dd'T'HH:mm:ss'Z' Short date: uuuu-MM-dd
isValidHarvesterId(Config, String) - Static method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 

J

JSON - de.pangaea.metadataportal.config.FieldConfig.DataType
 

K

KeyValuePairs - Class in de.pangaea.metadataportal.utils
Key/Value pairs used to build JSON.
KeyValuePairs() - Constructor for class de.pangaea.metadataportal.utils.KeyValuePairs
 

L

LenientDateParser - Class in de.pangaea.metadataportal.utils
Simple static class to parse date/times very lenient.
loadFromElasticSearchHit(SearchHit) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
"Harvests" a Elasticsearch SearchHit from index for re-parsing.
log - Variable in class de.pangaea.metadataportal.harvester.Harvester
Logger instance (shared by all subclasses).
LoggingErrorListener - Class in de.pangaea.metadataportal.utils
Helper class to correctly log TransformerExceptions with Commons Logging.
LoggingErrorListener(Class<?>) - Constructor for class de.pangaea.metadataportal.utils.LoggingErrorListener
A error listener using the supplied class name as log target.
LoggingErrorListener(Log) - Constructor for class de.pangaea.metadataportal.utils.LoggingErrorListener
A error listener using the supplied Commons Logging instance as log target.
LogUtil - Class in de.pangaea.metadataportal.utils
Simple static class that supplies PrintStreams for log methods.

M

main(String[]) - Static method in class de.pangaea.metadataportal.harvester.Harvester
External entry point to the harvester interface.
main(String[]) - Static method in class de.pangaea.metadataportal.harvester.Rebuilder
 
main(String[]) - Static method in class de.pangaea.metadataportal.harvester.UpdateAliases
 
main(String...) - Static method in class de.pangaea.metadataportal.push.PushServer
 
main(String[]) - Static method in class de.pangaea.metadataportal.utils.LenientDateParser
For testing the parser from command line.
makePathAbsolute(String) - Method in class de.pangaea.metadataportal.config.Config
makes the given local filesystem path absolute and resolve it relative to config directory
makePathAbsolute(String, boolean) - Method in class de.pangaea.metadataportal.config.Config
makes the given local filesystem path or URL absolute and resolve it relative to config directory (if local)
MetadataDocument - Class in de.pangaea.metadataportal.processor
This class holds all information harvested and provides methods for DocumentProcessor to create a XContentBuilder instance from it.
MetadataDocument(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.processor.MetadataDocument
Constructor, that creates an empty instance for the supplied index configuration.
MetadataDocument.XMLConverter - Class in de.pangaea.metadataportal.processor
This class handles the transformation from any source to the "official" metadata format and can even validate it
metadataPrefix - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
the used metadata prefix from the configuration
MinimalTransportClient - Class in de.pangaea.metadataportal.processor
This is a minimalistic TransportClient using Netty 4 only.
MinimalTransportClient(Settings, Class<? extends Plugin>...) - Constructor for class de.pangaea.metadataportal.processor.MinimalTransportClient
Creates a new transport client with pre-installed plugins.
MinimalTransportClient(Settings, Collection<Class<? extends Plugin>>) - Constructor for class de.pangaea.metadataportal.processor.MinimalTransportClient
Creates a new transport client with pre-installed plugins.
MinimalTransportClient(Settings, Collection<Class<? extends Plugin>>, TransportClient.HostFailureListener) - Constructor for class de.pangaea.metadataportal.processor.MinimalTransportClient
Creates a new transport client with pre-installed plugins.

N

name - Variable in class de.pangaea.metadataportal.config.FieldConfig
 
name - Variable in class de.pangaea.metadataportal.config.VariableConfig
 
NoCloseInputStream - Class in de.pangaea.metadataportal.utils
 
NoCloseInputStream(InputStream) - Constructor for class de.pangaea.metadataportal.utils.NoCloseInputStream
 
NoOpHarvester - Class in de.pangaea.metadataportal.harvester
This harvester can be used to 'disable' harvesting from a source, e.g.
NoOpHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.NoOpHarvester
 
NUMBER - de.pangaea.metadataportal.config.FieldConfig.DataType
 

O

OAI_NS - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
OAI_STATICREPOSITORY_NS - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
OAIException - Exception in de.pangaea.metadataportal.harvester
This exception is thrown on an OAI protocol error, which is triggered by an <error> response from the repository.
OAIException(String, String) - Constructor for exception de.pangaea.metadataportal.harvester.OAIException
 
OAIHarvester - Class in de.pangaea.metadataportal.harvester
Harvester for OAI-PMH repositories.
OAIHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.OAIHarvester
 
OAIHarvesterBase - Class in de.pangaea.metadataportal.harvester
Abstract base class for OAI harvesting support in panFMP.
OAIHarvesterBase(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
OAIMetadataDocument - Class in de.pangaea.metadataportal.harvester
Special implementation of MetadataDocument that adds OAI set support to internal fields
OAIMetadataDocument(HarvesterConfig, String, boolean) - Constructor for class de.pangaea.metadataportal.harvester.OAIMetadataDocument
Constructor, that creates an empty instance for the supplied index configuration.
OAIMetadataSaxRule - Class in de.pangaea.metadataportal.harvester
This class is used as a rule for the "metadata" element of the OAI response.
OAIMetadataSaxRule() - Constructor for class de.pangaea.metadataportal.harvester.OAIMetadataSaxRule
Creates a new rule which is enabled by default.
OAIStaticRepositoryHarvester - Class in de.pangaea.metadataportal.harvester
Harvester for OAI static repositories.
OAIStaticRepositoryHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
 
open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.DirectoryHarvester
 
open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.ElasticsearchHarvester
 
open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.Harvester
Opens harvester for harvesting documents described by the given HarvesterConfig.
open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
 
open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
 
open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.Rebuilder
 
open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.ZipFileHarvester
 
open(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 

P

Package - Class in de.pangaea.metadataportal
Class to get version information about panFMP.
PanFMP1IndexHarvester - Class in de.pangaea.metadataportal.harvester
This harvester supports replication XML contents from a legacy panFMP 1.x installation.
PanFMP1IndexHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.PanFMP1IndexHarvester
 
parent - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
 
parse(String, int) - Static method in class de.pangaea.metadataportal.utils.HostAndPort
Parses the given string to a InetSocketTransportAddress.
parseBoolean(String) - Static method in class de.pangaea.metadataportal.utils.BooleanParser
Parses a boolean value expressed as String
parseDate(String) - Static method in class de.pangaea.metadataportal.utils.LenientDateParser
Parses a string to a Date
parseLexicalQName(String, NamespaceContext) - Static method in class de.pangaea.metadataportal.utils.QNameParser
Parses the given string to a QName.
parseOAIDate(String) - Static method in class de.pangaea.metadataportal.utils.ISODateFormatter
Parses the given string from the OAI protocol into an Instant.
prepareReindex(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.Harvester
Prepares harvester for rebuilding the index by Rebuilder.
prepareReindex(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.harvester.Rebuilder
 
prepareReindex(ElasticsearchConnection, String) - Method in class de.pangaea.metadataportal.push.PushWrapperHarvester
 
processFilters() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Helper method that evaluates all filters.
processingInstruction(String, String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
 
processor - Variable in class de.pangaea.metadataportal.harvester.Harvester
Instance of DocumentProcessor that converts and updates the Elasticsearch instance in other threads.
processXPathVariables() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Helper method to process all user supplied variables for the XPath/Templates evaluation.
properties - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
 
PublicForDigesterUse - Annotation Type in de.pangaea.metadataportal.utils
This annotation is used to mark methods/classes that are only declared public for use by Digester but are not intended to be public.
PushServer - Class in de.pangaea.metadataportal.push
Provides a simple HTTP server that accepts push requests.
PushServer(Config, String, int, String) - Constructor for class de.pangaea.metadataportal.push.PushServer
 
PushWrapperHarvester - Class in de.pangaea.metadataportal.push
Fake Harvester class to implement by PushServer.
PushWrapperHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.push.PushWrapperHarvester
 

Q

QNameParser - Class in de.pangaea.metadataportal.utils
Simple static class to parse XPath-like string QNames ("prefix:tagname").

R

Rebuilder - Class in de.pangaea.metadataportal.harvester
Index rebuilder implemented as harvester that reads all documents from an index and pushes them back into the index.
Rebuilder(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.Rebuilder
 
recreateDigester() - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
 
recreateDigester() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
Recreates all digesters that are used by parsing the OAI XML.
recreateDigester() - Method in class de.pangaea.metadataportal.harvester.OAIStaticRepositoryHarvester
 
replayEndPrefixMappings(ContentHandler, Set<String>) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Replays all current prefix mappings for another ContentHandler (end mapping).
replayStartPrefixMappings(ContentHandler, Set<String>) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Replays all current prefix mappings for another ContentHandler (start mapping).
reset() - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
 
reset() - Method in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
Resets the internal variables.
resolveFunction(QName, int) - Method in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
resolveVariable(QName) - Method in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
RetryAfterIOException - Exception in de.pangaea.metadataportal.harvester
Thrown when HTTP server responds with HttpURLConnection.HTTP_UNAVAILABLE.
RetryAfterIOException(int, IOException) - Constructor for exception de.pangaea.metadataportal.harvester.RetryAfterIOException
 
RetryAfterIOException(int, String) - Constructor for exception de.pangaea.metadataportal.harvester.RetryAfterIOException
 
RetryAfterIOException(int, String, IOException) - Constructor for exception de.pangaea.metadataportal.harvester.RetryAfterIOException
 
retryCount - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
the retryCount from configuration
retryCount - Variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
the retryCount from configuration
retryTime - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
the retryTime from configuration
retryTime - Variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
the retryTime from configuration
root - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
 
root - Variable in class de.pangaea.metadataportal.config.TargetIndexConfig
 
runHarvester(Config, String) - Static method in class de.pangaea.metadataportal.harvester.Harvester
Harvests one (harvesterId='name') or more (harvesterId='*' ) sources.
runHarvester(Config, String, Class<? extends Harvester>) - Static method in class de.pangaea.metadataportal.harvester.Harvester
Harvests one (harvesterId="name") or more ( harvesterId="*"/"all"/null) sources.
runRebuilder(Config, String) - Static method in class de.pangaea.metadataportal.harvester.Rebuilder
 
runUpdateAliases(Config, String) - Static method in class de.pangaea.metadataportal.harvester.UpdateAliases
 

S

saxFactory - Static variable in class de.pangaea.metadataportal.utils.StaticFactories
 
SaxRule - Class in de.pangaea.metadataportal.utils
This class is used as a rule for included documents during Digester parsing.
SaxRule() - Constructor for class de.pangaea.metadataportal.utils.SaxRule
Default constructor
schema - Variable in class de.pangaea.metadataportal.config.Config
 
sendCompressionHeaders(HttpRequest.Builder) - Static method in class de.pangaea.metadataportal.utils.HttpClientUtils
Sends "Accept-Encoding" header to ask server to compress result.
sendHttpRequestWithRetry(HttpClient, HttpRequest, HttpResponse.BodyHandler<T>) - Static method in class de.pangaea.metadataportal.utils.HttpClientUtils
Workaround for: https://stackoverflow.com/questions/55087292/how-to-handle-http-2-goaway-with-httpclient
serializeToContentBuilder(XContentBuilder) - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
Serializes the object to a sequence of fields.
setAugmentation(String) - Method in class de.pangaea.metadataportal.config.Config
Deprecated.
setContentHandler(ContentHandler) - Method in class de.pangaea.metadataportal.utils.SaxRule
Sets the SAX ContentHandler that gets all SAX Events after the startElement event.
setCustomContentHandler(ContentHandler) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Sets a custom ContentHandler, that receives all SAX events until disabled (null).
setDataType(String) - Method in class de.pangaea.metadataportal.config.FieldConfig
Deprecated.
setDatestamp(Instant) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Set the datestamp (last modification time of document file).
setDatestampField(String) - Method in class de.pangaea.metadataportal.config.Config
Deprecated.
setDefault(String) - Method in class de.pangaea.metadataportal.config.FieldConfig
 
setDeleted(boolean) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Marks a harvested document as deleted.
setDigester(Digester) - Method in class de.pangaea.metadataportal.utils.SaxRule
Set the Digester with which this Rule is associated.
setEnabled(boolean) - Method in class de.pangaea.metadataportal.harvester.OAIMetadataSaxRule
If enabled, a DOM tree is build from metadata.
setErrorHandler(ErrorHandler) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Not suppoted, always throws IllegalArgumentException if not null.
setEsMappingFile(String) - Method in class de.pangaea.metadataportal.config.Config
Deprecated.
setEsSettings(Settings.Builder) - Method in class de.pangaea.metadataportal.config.Config
Deprecated.
setExcludeNamespaces(Set<String>) - Method in class de.pangaea.metadataportal.utils.SaxRule
Sets a Set<String> containing all Namespace URIs that should not be feed to the target ContentHandler on match.
setFilterDefault(String) - Method in class de.pangaea.metadataportal.config.Config
Deprecated.
setFinalDOM(Document) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Sets XML final (transformed) xml contents as DOM tree.
setGranularity(String) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
Deprecated.
setHaltOnSchemaError(String) - Method in class de.pangaea.metadataportal.config.Config
Deprecated.
setHarvesterClass(String) - Method in class de.pangaea.metadataportal.config.HarvesterConfig
Deprecated.
setHarvestingDateReference(Instant) - Method in class de.pangaea.metadataportal.harvester.Harvester
Reference date of this harvesting event (in time reference of the original server).
setHeaderInfo(String, String, String) - Method in class de.pangaea.metadataportal.harvester.OAIMetadataDocument
Deprecated.
setIdentifier(String) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Set the document identifier.
setIndexSettings(Settings.Builder) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
Deprecated.
setName(ExtendedDigester, String) - Method in class de.pangaea.metadataportal.config.VariableConfig
Deprecated.
setName(String) - Method in class de.pangaea.metadataportal.config.FieldConfig
 
setNameSuffix1(String) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
 
setNameSuffix2(String) - Method in class de.pangaea.metadataportal.config.TargetIndexConfig
 
setRequest(Map<String, String>) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
Deprecated.
setResponseDate(String) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
Deprecated.
setResumptionToken(String, String, String, String) - Method in class de.pangaea.metadataportal.harvester.OAIHarvester
Deprecated.
setRulesWithInvalidElementCheck(Rules) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Adds a default Rule for not allowing invalid (not registered) event paths.
sets - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
the sets to harvest from the configuration, null to harvest all
sets - Variable in class de.pangaea.metadataportal.harvester.OAIMetadataDocument
 
setSchema(String, String) - Method in class de.pangaea.metadataportal.config.Config
 
setSourceField(String) - Method in class de.pangaea.metadataportal.config.Config
Deprecated.
setTemplate(Templates) - Method in class de.pangaea.metadataportal.config.ExpressionConfig
 
setTemplate(Templates) - Method in class de.pangaea.metadataportal.config.FilterConfig
 
setType(String) - Method in class de.pangaea.metadataportal.config.FilterConfig
Deprecated.
setTypeName(String) - Method in class de.pangaea.metadataportal.config.Config
Deprecated.
setValidIdentifiers(Set<String>) - Method in class de.pangaea.metadataportal.harvester.Harvester
Set a set of all "seen" valid identifiers.
setXMLField(String) - Method in class de.pangaea.metadataportal.config.Config
Deprecated.
setXPath(ExtendedDigester, String) - Method in class de.pangaea.metadataportal.config.ExpressionConfig
Deprecated.
SingleFileEntitiesHarvester - Class in de.pangaea.metadataportal.harvester
Abstract harvester class for single file entities (like files from web page or from a local directory).
SingleFileEntitiesHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
 
SingleFileEntitiesHarvester(HarvesterConfig, DocumentErrorAction) - Constructor for class de.pangaea.metadataportal.harvester.SingleFileEntitiesHarvester
 
size() - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
 
skippedEntity(String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
 
startDocument() - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
 
startElement(String, String, String, Attributes) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
 
startPrefixMapping(String, String) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
 
StaticFactories - Class in de.pangaea.metadataportal.utils
Some pre-allocated XML factories.
STOP - de.pangaea.metadataportal.processor.DocumentErrorAction
 
STRING - de.pangaea.metadataportal.config.FieldConfig.DataType
 

T

TargetIndexConfig - Class in de.pangaea.metadataportal.config
Configuration of an index in Elasticsearch.
TargetIndexConfig(Config, String) - Constructor for class de.pangaea.metadataportal.config.TargetIndexConfig
Default constructor
targetIndexes - Variable in class de.pangaea.metadataportal.config.Config
 
timeout - Variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
the timeout from configuration
timeout - Variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
the timeout from configuration
toString() - Method in class de.pangaea.metadataportal.config.ExpressionConfig
 
toString() - Method in class de.pangaea.metadataportal.config.FieldConfig
 
toString() - Method in class de.pangaea.metadataportal.config.FilterConfig
 
toString() - Method in class de.pangaea.metadataportal.config.VariableConfig
 
toString() - Method in class de.pangaea.metadataportal.harvester.OAIMetadataDocument
 
toString() - Method in class de.pangaea.metadataportal.processor.MetadataDocument
 
toString() - Method in class de.pangaea.metadataportal.utils.KeyValuePairs
transFactory - Static variable in class de.pangaea.metadataportal.utils.StaticFactories
 
transform(Source) - Method in class de.pangaea.metadataportal.processor.MetadataDocument.XMLConverter
 
type - Variable in class de.pangaea.metadataportal.config.FilterConfig
 
typeName - Variable in class de.pangaea.metadataportal.config.Config
 

U

unsetVariables() - Method in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
updateAliases(TargetIndexConfig) - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
Closes the index after harvesting and update the aliases to point to the active index.
UpdateAliases - Class in de.pangaea.metadataportal.harvester
TODO
UpdateAliases() - Constructor for class de.pangaea.metadataportal.harvester.UpdateAliases
 
USER_AGENT - Static variable in class de.pangaea.metadataportal.harvester.OAIHarvesterBase
 
USER_AGENT - Static variable in class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
 
USER_AGENT - Static variable in class de.pangaea.metadataportal.harvester.ZipFileHarvester
 

V

validateWithAugmentation - Variable in class de.pangaea.metadataportal.config.Config
 
valueOf(String) - Static method in enum de.pangaea.metadataportal.config.FieldConfig.DataType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.pangaea.metadataportal.config.FilterConfig.FilterType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.pangaea.metadataportal.processor.DocumentErrorAction
Returns the enum constant of this type with the specified name.
values() - Static method in enum de.pangaea.metadataportal.config.FieldConfig.DataType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.pangaea.metadataportal.config.FilterConfig.FilterType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.pangaea.metadataportal.processor.DocumentErrorAction
Returns an array containing the constants of this enum type, in the order they are declared.
VARIABLE_DOC_DATESTAMP - Static variable in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
VARIABLE_DOC_IDENTIFIER - Static variable in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
VARIABLE_HARVESTER_ID - Static variable in class de.pangaea.metadataportal.processor.XPathResolverImpl
 
VariableConfig - Class in de.pangaea.metadataportal.config
A config element that supplies a variable like variables in XPath.
VariableConfig() - Constructor for class de.pangaea.metadataportal.config.VariableConfig
 

W

waitForYellow(TargetIndexConfig) - Method in class de.pangaea.metadataportal.processor.ElasticsearchConnection
 
walkNodeTexts(StringBuilder, Node, boolean) - Method in class de.pangaea.metadataportal.processor.MetadataDocument
Helper method to walk through a DOM tree node (n) and collect strings.
warning(TransformerException) - Method in class de.pangaea.metadataportal.utils.LoggingErrorListener
Logs message and location with WARN method.
warning(SAXParseException) - Method in class de.pangaea.metadataportal.utils.ExtendedDigester
Logs the SAX exception as warning (with location).
WebCrawlingHarvester - Class in de.pangaea.metadataportal.harvester
Harvester for traversing websites and harvesting XML documents.
WebCrawlingHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.WebCrawlingHarvester
 

X

XHTML - de.pangaea.metadataportal.config.FieldConfig.DataType
 
XML - de.pangaea.metadataportal.config.FieldConfig.DataType
 
XMLToKeyValuePairs - Class in de.pangaea.metadataportal.utils
Used to serialize Node from a DOM tree to an Object (mainly KeyValuePairs).
XMLToKeyValuePairs(boolean) - Constructor for class de.pangaea.metadataportal.utils.XMLToKeyValuePairs
 
xPathExpr - Variable in class de.pangaea.metadataportal.config.ExpressionConfig
 
xpathFactory - Static variable in class de.pangaea.metadataportal.utils.StaticFactories
 
XPathResolverImpl - Class in de.pangaea.metadataportal.processor
Helper class that implements several XPath interfaces to supply variables and functions to XPath expressions.
xPathVariables - Variable in class de.pangaea.metadataportal.config.Config
 
xslt - Variable in class de.pangaea.metadataportal.config.ExpressionConfig
 
xslt - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
 
xsltParams - Variable in class de.pangaea.metadataportal.config.HarvesterConfig
 

Z

ZipFileHarvester - Class in de.pangaea.metadataportal.harvester
Harvester for unzipping ZIP files and reading their contents.
ZipFileHarvester(HarvesterConfig) - Constructor for class de.pangaea.metadataportal.harvester.ZipFileHarvester
 
A B C D E F G H I J K L M N O P Q R S T U V W X Z 
All Classes All Packages