Qluster is designed to solve the unruly file ingestion problem.
Qluster provides a Data Firewall that protects your data pipeline from bad data, reduces your engineering effort, and empowers business and operations people to handle data issues.
Qluster Data Purification In Transit: The first layer of defense against bad data
Vendors can use AWS S3, Google Cloud Storage, SFTP, DropBox, Google Drive, Google Sheets, or Restful clients to push data to Qluster.
If you need a connection that you don't see above, feel free to drop us a line. We are here to solve your problems.
Qluster supports Postgres, SnowFlake, Redshift, and many other relational databases as the destination.
You can also have Qluster push data to object storage services such as AWS S3, Google Cloud Storage, and others.
For advanced use cases, the data can be pushed to external API's.
A lot of work has gone into making sure that Qluster never locks your Postgres tables and keeps the historic data accessible.
We empower engineers to build sophisticated data cleaning and validation logic in any language and run it as docker images within Qluster.
It can be as easy as getting the input file mounted on the docker image for the custom code to take over or as comprehensive as using Qluster's API directly.
Admins have a 360° view on the data pipelines. They can create new datasets, data sources, destinations, etc. They can resolve data issues across data sources, approve database migrations, and view all the data in all destinations.
The admin console provides the answer to who did what when.
Historically one of the pains of data ingestion has been that the onus of cleaning data is on the recipient of data. Now with Qluster's user interface, we empower anyone including the data senders i.e. vendors to do their fair share of data cleaning! The vendor users can only access their own data and resolve issues specific to their own data.
Receive Slack notifications as soon as an issue requires your attention. You can control how often you receive the notifications.
Vendors can receive notifications for their own data as well!
Email and PagerDuty notification integrations are coming soon.
Hosted Qluster on GCP is operational. We support Google Cloud Storage as a data source and a backup storage.
Hosted Qluster on AWS is operational
for enterprise deployments.
SaaS deployment is in Beta.
Hosted Qluster on Azure is coming in 2023.
We create solid data tools. DeepDiff has over 6.4 million monthly downloads.
Companies such as Google, Netflix, and Uber are among the major users of DeepDiff .
Uber's Peloton uses DeepDiff
Netflix's Security Monkey uses DeepDiff
Google DeepMind's Pysc2 uses DeepDiff
Cisco's Data Center uses DeepDiff