Molinos Río de la Plata

From manual to automatic:
the data extraction process at Molinos Río de la Plata

Logo Molinos

DinoCloud, a cloud-first company, and AWS Premier Partner has cutting-edge resources and the technical expertise to carry out projects that accompany companies of various industries on their way to digital transformation and process automation in the cloud. Molinos Río de la Plata is Argentina’s largest branded food products company. The company is a prominent exporter of sunflower processed oil and is one of Argentina’s leading exporters of bottled oil. Molinos Río de la Plata and DinoCloud started their professional relationship with DinoCloud in December 2021.

Our working relationship began with a local billing project, another of DinoCloud’s areas of expertise, which allows Argentinian companies to pay their AWS cloud expenses in the local currency of the country. Due to the good interpersonal and professional relationships sprung from this project, Molinos Río de la Plata contacted the commercial area of DinoCloud to address another need: the automation of the data extraction processes of the Precios Claros program. This government-boosted program seeks to achieve competitive equity through the exhibition of the retail price of products by competitors in the food market.

Before starting this project, Molinos Rio de la Plata used a PowerShell script to manually extract data from the program and then load it into a SQL Server database. This manual process was a major operational disadvantage as it hindered achieving high availability data for strategic decision-making and increased the possibility of errors in data reading and extraction.
To address this need, DinoCloud presented Molinos Río de la Plata, a project whose main objective was the implementation of an Automatic Data Lake to extract and transform data from the program. This project was intended to last one month in three milestones.

Discovery, infrastructure, and migration

The project to automate the data extraction processes of the Precios Claros program was carried out in three different milestones:

Discovery

This stage consisted of understanding the processes being carried out by the client. Also, two meetings were held with the client to understand which needs needed to be addressed by DinoCloud.

Setting up the infrastructure for data processing

The main task of this milestone was to put together the workflow in AWS Glue to automate data processing. To execute this, DinoCloud set up roles and keys with the AWS IAM service, created and configured AWS S3 buckets, and created jobs in AWS Glue. In addition, DinoCloud developed ETL pipelines on AWS Glue and assembled the data architecture in Amazon Redshift to support the queries needed for reports in PowerBI. This stage culminated in the completion of the workflow.

Migration of scraping processes to AWS

Once the architecture was created, it was necessary to perform the migration of the scraping process, which was completed.

Project results

The project’s results were the automation of data extraction, transformation, and loading, which translated into a substantial reduction in operating times and the possibility of errors due to manual work. 

Furthermore, we were able to train staff on AWS tools that they were unaware of and immersed them in the cloud world. During three months and once a week, meetings were held to demonstrate the work methodology and to transfer knowledge. Finally, the entire workflow was documented so that Molinos Río de la Plata’s engineering team could access it when needed. 

The initial duration of the project was one month, during which time the tasks described above were performed, although the contract was extended twice. The first contract renewal took place due to the need to continue providing support for knowledge transfer to Molinos Río de la Plata personnel. The second renewal took place within a framework of research and implementations for process improvements. 

As for process improvements, these were as follows:

Conclusion

The DinoCloud project with Molinos Río de la Plata was a success, and the automation of the data extraction process of the Precios Claros program was achieved, allowing faster strategic decision-making in a very competitive market. Now, Molinos Río de la Plata is more involved in the cloud world and in digital transformation thanks to the experience and technical expertise of DinoCloud.

Get in touch

(*) Required fields