Welcome
Resource Adapters
About the HCL Link Resource Adapters, and how to use them.
BigQuery Adapter
The BigQuery adapter provides access to the BigQuery-managed data warehouse service on the Google Cloud Platform (GCP).
Examples
The adapter alias for the BigQuery adapter is BIGQUERY. It needs to be specified as the first argument in the GET and PUT map functions.
GET map function

Introduction
Congratulations on your selection of HCL Link as your data integration solution!
What's New
Release Notes
System requirements
A complete desciption of the hardware and software requirements for both Windows and Linux systems.
Installation
Everything you need to know to install HCL Link.
Administration
Here you will find the tasks that are required for administration of your HCL Link product.
Projects
A project is a container for HCL Link artifacts.
Services
Service definitions define REST services and the endpoints of a service. This guide provides step-by-step instructions for creating, importing, and managing services using the system interface, following Microsoft standards.
Connectors
This documentation describes the connectors and how they are used.
Packages
Servers
This documentation contains a description of the server groups and servers.
Variables
The variables described here include Configuration variables, flow variables, and cache variables.
Dashboards
A description of HCL Link dashboards, including the Server dashboard and the Kibana dashboard.
Runtimes
Descriptions of Link runtime services.
Resource Adapters
About the HCL Link Resource Adapters, and how to use them.
- Resource Adapters overview
  Resource adapters are used to retrieve and route data. They provide access to databases, files, messaging systems, enterprise applications and other data sources and targets.
- Actian Adapter
  This documentation describes the Actian Adapter.
- Apache HDFS Adapter
  The Apache HDFS Adapter allows the HCL Link to access the HDFS file system in Apache Hadoop environments.
- Apache ActiveMQ Adapter
  With the ActiveMQ Adapter, users can access any of the queues of the Active MQ Adapter to send and receive messages. Users can also create a new queue altogether for sending and receiving messages.
- Azure Service Bus Adapter
  The Azure Service Bus adapter supports accessing queue and topics on the Microsoft Azure Service Bus, a fully managed message broker service on the Microsoft Azure cloud.
- Azure SQL Adapter
  Microsoft Azure SQL Database is a general-purpose relational database, provided as a managed service. With it, you can create a highly available and high-performance data storage layer for the applications and solutions in Azure.
- Azure Blob Storage Adapter
  The Azure Blob Storage adapter provides support to perform read and write operations on the blobs in the block storage managed by the Azure Blob Storage cloud service
- Apache Kafka Adapter
  With the Apache Kafka adapter, maps can connect to a Kafka cluster to consume and produce messages.
- Amazon S3 Adapter
  This documentation discusses the Amazon S3 Adapter.
- Amazon SNS Adapter
  With the Amazon SNS adapter, a user can access the Amazon Simple Notification Services. This adapter connects to the Simple Notification Services (SNS) topics, using AWS keys. The adapter can fetch and send notifications from and to those AWS SNS topics, to which the user has subscribed.
- Amazon SQS Adapter
  With the Amazon SQS or Amazon Simple Queue Service adapter, a user can access Amazon Simple Queue Services. The adapter connects to the fully managed Amazon Simple Queue Service system, using AWS keys. The SQS adapter can send and fetch messages to and from the queues to which a user has access.
- Batch File and Shell Script Adapters
  The Batch File adapter processes a (Windows™) batch file as the data source of an input map card or the data target of an output map card. The Shell Script adapter processes a (UNIX™) shell script as the data source of an input map card or the data target of an output map card.
- BigQuery Adapter
  The BigQuery adapter provides access to the BigQuery-managed data warehouse service on the Google Cloud Platform (GCP).
  - Introduction
    The BigQuery adapter can be used in maps and flows to read and write rows in BigQuery tables.
  - Prerequisites
    The adapter accesses the BigQuery service programmatically through the BigQuery API.
  - Authenticating Connections
  - Adapter Operations
  - Adapter Properties and Commands
    Adapter properties are used to configure the BigQuery adapter connections, actions, cards, and nodes in the Design Server Web UI.
  - Design Time Operations
  - Examples
    The adapter alias for the BigQuery adapter is BIGQUERY. It needs to be specified as the first argument in the GET and PUT map functions.
    - GET map function
    - PUT map function
- Cipher Adapter
  The Cipher adapter encrypts and decrypts data by using the Advanced Encryption Standard (AES) established by the U.S. National Institute of Standards and Technology (NIST). A single cryptographic key enciphers (encrypts) and deciphers data. The cryptographic key is stored in a master key file (MKF) in an AES-based encrypted format. As long as the MKF is not compromised or lost, the enciphered data is cryptographically secure.
- Email Adapters
  An email adapter automatically receives email messages as sources of a map or sends email messages as targets of a map.
- FTP Adapter
  Use the File Transfer Protocol (FTP) Adapter to transport data. When source data arrives at its target, it often must be transformed into a different format for a receiving application to use it successfully.
- Excel Adapter
  The Excel Adapter reads data from and maps data to a sheet in a Microsoft Excel workbook. In Design Studio, use the Excel importer (File > Import > Excel) to create a type tree based on a specified worksheet in the Excel workbook.
- Google Analytics 4 Adapter
  The Google Analytics 4 (GA4) adapter provides access to dimensions, metrics, and reports in the GA4 account.
- Google Cloud Storage Adapter
  The Google Cloud Storage Adapter provides access to Google Cloud Storage buckets and objects in the Google Cloud Platform.
- Google Pub / Sub Adapter
  The Google Cloud Pub/Sub adapter provides access to Google Cloud Pub/Sub topics and subscriptions in the Google Cloud Platform.
- Google Drive Adapter
- Google Sheets Adapter
- GZIP/ZLIB Adapter
  Use the GZIP/ZLIB Adapter to retrieve data in file or memory formats and export data for GZIP, ZLIB and Plain file formats.
- HTTP Adapter
- IBM MQ Adapter
  The IBM® MQ adapter works with IBM MQ to accomplish the task of maintaining data compatibility, handling all kinds of data transformations from the simplest to the most complex.
- Java Class Adapter
  Use the Java Class Adapter to instantiate a Java™ object and to invoke a sequence of methods on the object.
- HL7 MLLP Adapter
  The HL7 MLLP adapter uses the MLLP protocol over TCP/IP to pass data to and from HCL Link. The adapter has a listener interface that can detect the arrival of data on a socket and trigger a map to run. With the HL7 MLLP adapter, remote applications can pass data to HCL Link without using additional middleware software.
- JAXB Adapter
  The JAXB adapter converts Java™ objects to XML and converts XML to Java objects. With the JAXB adapter, you can build Java objects that can be represented with XML, parse the objects, and use them in maps. The JAXB adapter supports all JAXB properties for marshalling and unmarshalling an XML document.
- JDBC Adapter
  Use the Java Database Connectivity (JDBC) adapter to query or update a database through the appropriate JDBC driver for the database.
- JMS Adapter
  Use the Java™ Message Service (JMS) Adapter as a client to any JMS-compliant messaging system provider.
- JNDI Adapter
  Use the Java™ Naming and Directory Interface (JNDI) Adapter to enable maps to look up, add, modify and delete entries in external directories, and retrieve the results that these operations return so that they can be reused in a map.
- MongoDB Adapter
  This documentation describes the MongoDB Adapter.
- OData Adapter
  The OData (Open Data Protocol) adapter provides support for performing read and write operations on data sources that expose OData interface. OData adapter is an ISO/IEC approved, OASIS standard that defines a set of best practices for building and consuming RESTful APIs.
- OneDrive Adapter
  The OneDrive adapter provides support to access the Microsoft OneDrive content management service from the HCL Link.
- OpenPGP Adapter
  Use the OpenPGP Adapter to exchange information with the GnuPG application.
- PDF Adapter
  The PDF Adapter works with Acrobat forms and templates to generate a PDF document or extract data from all or part of an input PDF document.
- Redis Adapter
- REST Adapter
  REST adapter is a solution where Link can readily call any Web/REST API and provide easy mapping to and from the APIs.
- RabbitMQ Adapter
  This documentation describes the RabbitMQ Adapter.
- SAP BAPI Adapter
  The SAP BAPI contains the BAPIs which internally invokes Remote Function Calls (RFCs) which is necessary to pass inbound and outbound data to and from SAP R/3.
- SAP R/3 ALE Adapter
  This documentation describes the SAP R/3 ALE Adapter.
- Salesforce Adapter
  Salesforce Adapter provides support to access Salesforce REST API resource. It is useful for abstracting a piece of information or an action.
- ServiceNow Adapter
  The ServiceNow adapter provides support for accessing ServiceNow REST API resources.
- SFTP Adapter
  With the Secure File Transfer Protocol (SFTP) adapter, you can send and fetch files securely to and from an SFTP server.
- SharePoint Adapter
- SOAP Adapter
  This documentation describes the SOAP Adapter.
- SOAP (Legacy) Adapter
  SOAP defines the XML-based message format that applications use to communicate and inter-operate with each other over the Web.
- Socket Adapter
  The Socket Adapter provides a means of passing data to and from HCL Link through standard TCP/IP sockets.
- Archive (Tar) Adapter
  This documentation introduces the Archive (Tar) adapter. You can use the adapter with a Command Server, Software Development Kit, or map in a map rule.
- Archive (Zip) Adapter
  Use the Archive (Zip) Adapter with a Command Server, Software Development Kit, or map in a map rule.
Cloud Native Link
Cloud Native Link refers to the HCL Link product installation on a Kubernetes cluster.
Reference
This documentation provides HCL Link reference information.
Notices

GET map function

GET map function with 2 arguments

The following is an example of a GET map function used to read records from a table (-READMODE read_table). The table to retrieve the data from is the teachers table (-TABLE teachers), in the staff dataset (-DATASET staff).

The adapter is using the service account private key credentials file (-CREDENTIALSFILE /tmp/creds/key.json) for authentication.

The adapter logging is enabled at the verbose level (-TV), and since the adapter trace file was not specified, the default log file (m4bigquery.mtr) is created automatically in the map directory.

GET("BIGQUERY","-CREDENTIALSFILE /tmp/creds/key.json -READMODE read_table -DATASET staff -TABLE teachers -TV")

GET map function with 3 arguments (lookup operation)

The following is an example of a GET map function used to look up records using a parameterized SELECT query statement (-WRITEMODE execute_parameterized_query). The statement used is specified in the -QUERY 'SELECT id,name,dob FROM staff.teachers WHERE name=@name AND dob >= @min_dob LIMIT 1' command. The order of the parameters and their respective data types are specified in the -PARAMETERS 'name:STRING min_dob:DATE' command.

The values to set for the parameters are provided in the third argument of the GET map function. In this example, the fixed parameter values are specified (john|1980-01-01). This will result in the adapter returning a record for a teacher named John born in 1980 or later. Even if there are more than one teacher records that meet this criteria, only one will be returned because of the (-LIMIT 1) clause included in the statement.

In a more realistic scenario, the statement parameter values would be constructed from the incoming data values on the input link, instead of being hard-coded.

The adapter is using the service account private key credentials file (-CREDENTIALSFILE /tmp/creds/key.json) for authentication.

The adapter logging is enabled at the verbose level (-TV), and the log messages are written to the specified log file (/tmp/bq.adapter.log).

GET("BIGQUERY","-CREDENTIALSFILE /tmp/creds/key.json -WRITEMODE execute_parameterized_query -QUERY 'SELECT id,name,dob FROM staff.teachers WHERE name=@name AND dob >= @min_dob LIMIT 1' -PARAMETERS 'name:STRING min_dob:DATE' -TV /tmp/bq.adapter.log", "john|1980-01-01")