Collect Singer JSONL data into your data warehouse or ours. The Matatika pipelines will take care of the data collection and preparation for your analytics and BI tools.
Singer JSONL is a data integration tool.
Singer JSONL is an open-source data integration tool that allows users to extract data from various sources, transform it, and load it into a destination of their choice in JSONL format. It supports a wide range of data sources and destinations, including databases, APIs, and cloud-based services, and can be easily extended with custom connectors. Singer JSONL is designed to be simple, reliable, and scalable, making it a popular choice for data integration projects of all sizes.
The URL or file path to the JSONL data source.
Whether or not to add metadata to each record, such as a timestamp and source.
A list of folders to search for JSONL files.
Whether or not to search for JSONL files recursively within the specified folders.
A list of specific file paths to JSONL files.
The name of the S3 bucket containing the JSONL files.
The prefix within the S3 bucket where the JSONL files are located.
S3 file paths to singer-formatted files. Note: extension is ignored, and compression is inferred automatically by smart_open
. Both s3.prefix
and s3.paths
can be specified together.
Extract, Transform, and Load Singer JSONL data into your data warehouse or ours.