Share this post on:

I have explored using a database model instead of CSV files for storing and retrieving data. I have done some experimenting and considered that the final application will probably be stored in two parts (backend and frontend) on a Cloud provider, probably Azure for development as I already have a student account with them. Given the relatively small amount of data stored and retrieved and the speed at which Pandas can do that from CSV files, there seems no benefit at this stage in changing the architecture to a database.

I have also considered the cost, and it seems that on Azure using a database is likely to be more costly than using Blob Storage Containers which are extremely cheap and seem easy to access from a python script.

One of my recommendations for the future however was that if the project was likely to grow beyond one site and become a commercial product, that the architecture is moved to a database that will handle concurrency and size much better than CSV files.

Share this post on:

Leave a Comment

Your email address will not be published. Required fields are marked *