MarkLogic Content Pump (mlcp)

MarkLogic Content Pump is an open-source, Java-based command-line tool (mlcp). mlcp provides the fastest way to import, export, and copy data to or from MarkLogic databases. It is designed for integration and automation in existing workflows and scripts.

The MarkLogic Content Pump is developed in the open on GitHub. Submit tickets and pull requests there to contribute.

MarkLogic Content Pump on GitHub ›

Download

Release 10.0.2 binaries zip package 29.6 MB(SHA1)
Release 10.0.2 source zip package 375 KB(SHA1)

Maven

Dependencies

Features

Content Pump can:

Data sources and destinations

Content Pump supports moving data between a MarkLogic database and any of the following:

  • Local filesystem
  • HDFS
  • MarkLogic archive
  • Another MarkLogic database

Formats

Content Pump supports

The popular RecordLoader and XQSync projects have served as inspirations for Content Pump. However, mlcp is not designed for compatibility with either of those tools.

Getting Started with MLCP

You may find this free online training course helpful.

To get started moving data with mlcp, download and unpack the binaries. For those interested in hacking or look at the internals, you can also download the Apache 2.0 licensed source.

To create your first import script make sure you have an XDBC server attached to your database (running on port 8006, for example, below). From the command line, run the following, substituting your particulars.

To export a subset of that same database into a platform-independent archive:

To import all triples from an N-Triples formated file named example.nt:

This is a small sampling of the rich set of capabilities that mlcp provides. For much more information, sample code, and examples in the documentation.

Documentation


Older versions

MarkLogic 9

Release 9.0.10.2 binaries zip package 30 MB(SHA1)
Release 9.0.10.2 source zip package 376 KB(SHA1)

Maven

Dependencies

MarkLogic 8

Release 8.0.9 binaries zip package 29 MB(SHA1)
Release 8.0.9 source zip package 430 KB(SHA1)
Release 8.0.9 binaries zip package for use with MapR 31 MB(SHA1)

Maven

Dependencies

Stack Overflow iconStack Overflow: Get the most useful answers to questions from the MarkLogic community, or ask your own question.