Planet Cassandra
Illustration Image

Require a design suggestion for generating files from cassandra [closed]

I have to create multiple reports on a daily basis from a Cassandra table, and in 24 hours the data could be close to a million rows.

I initially thought of running a single query and get the data using paging and keep a local copy of file and upload to an ftp server. But my application is running on a Kubernetes cluster so can't create local files as this is not recommended.

So I am trying to get the data out of Cassandra and stream the data using Flink job and push the data to ObjectStore(Azure blob) and once the data is uploaded completely I will upload the file to an ftp server.

I'm not sure whether this will work or not, any suggestions or improvements on this design.

Become part of our
growing community!
Welcome to Planet Cassandra, a community for Apache Cassandra®! We're a passionate and dedicated group of users, developers, and enthusiasts who are working together to make Cassandra the best it can be. Whether you're just getting started with Cassandra or you're an experienced user, there's a place for you in our community.
A dinosaur

What's New?

Events

Use Cases

ChangeLog

Planet Cassandra is a service for the Apache Cassandra® user community to share with each other. From tutorials and guides, to discussions and updates, we're here to help you get the most out of Cassandra. Connect with us and become part of our growing community today.
© 2009-2023 The Apache Software Foundation under the terms of the Apache License 2.0. Apache, the Apache feather logo, Apache Cassandra, Cassandra, and the Cassandra logo, are either registered trademarks or trademarks of The Apache Software Foundation. Sponsored by Anant Corporation and Datastax, and Developed by Anant Corporation.

Get Involved with Planet Cassandra!

We believe that the power of the Planet Cassandra community lies in the contributions of its members. Do you have content, articles, videos, or use cases you want to share with the world?