Machine & Deep Learning Optimization – SPAIN
Machine & Deep Learning Optimization - SPAIN
Key Technologies
- ECOMMERCE
- ANALYTICS
- DEEP LEARNING
- DATABRIKCS
- AZURE
The Challenge
Find a parallelization alternative for the training of neural models for massive data, seeking that the result is scalable and adaptive according to the amount and type of data that is processed
The Solution
myAIDoor proposes the development of a training strategy that includes libraries such as Horovod and MirroredRunner, all this executed on a Databricks environment, for the creation of the model, Keras and Tensorflow libraries are used, which take advantage of the technology proposed by Azure.
The Result
A sample is created of how the different types of data should be approached, their transformations and strategies for processing and training in a distributed way so that the maximum benefit of Azure technology is obtained, thus achieving scalability and improvements in the times of data processing.