Data Load utility architectural overview
In order to work with the Data Load utility, you must first have an understanding of how it works.
The following diagram describes the components of the Data Load utility:
- Business object builder layer
- The business object builder layer contains the data reader and the business object builder. The
data reader is responsible for reading the raw data and passing it to the business object builder
for processing and building business objects. The business object builder takes the data as input
from the data reader, then populates and instantiates the business objects. Each business object is
defined as a common entity throughout the WebSphere Commerce data model. In other words, you
only have to understand a single representation of the data through the store front, authoring
tools, and the data load infrastructure.
The business object builder layer supports different types of data sources, such as data stored in comma-separated values (CSV) format, XML files, external databases, and enterprise resource planning (ERP) systems. A CSV data reader is provided with the Data Load utility. It is necessary to create custom data readers in order to support data sources of types other than CSV files.
An XML data reader is provided with the Data Load utility. This data reader supports a specific XML format. If your input files use a different format of XML data, you must create a custom data reader to support you XML file format.
The following business object builders are provided:- com.ibm.commerce.foundation.dataload.businessobjectbuilder.BaseBusinessObjectBuilder
- com.ibm.commerce.foundation.dataload.businessobjectbuilder.TableObjectBuilder
- Business object mediator layer
- The business object mediator layer contains the business object mediator. The business object
mediator converts the business objects into objects that represent the physical database schema,
also referred to as physical objects. Several mediators are available for catalog, inventory, and
price components. A TableObjectMediator is also provided to support loading data to any table.
The ID resolver is also a part of the business object mediator layer. It is used to figure out if a physical object, which represents a row in a table, exists in a database. If the object is in the database, it returns the existing primary key of the object. Otherwise, it returns a new primary key for this new physical object.
- Persistence layer
- The persistence layer persists the physical objects into the WebSphere Commerce database.
Two data writers are provided:
- com.ibm.commerce.foundation.dataload.datawriter.JDBCDataWriter
- com.ibm.commerce.foundation.dataload.datawriter.NativeDBDataWriter
- Business context service
- The business context service manages contextual business information. The information is encapsulated within the different layers of the Data Load utility, and can be reused when needed to improve efficiency. Business objects uses a business context to represent common configuration information necessary to load data such as for a particular store, member IDs, or language. The context can also store component-specific configuration information such as master catalog identifiers, or invocation-specific configuration information such as the specific persistence mechanism and parameters.