The current machine learning training and testing process is not rigorous enough to ensure that the models being trained will work in the real world. During the training process many different models can be produced that all perform equally well when tested in lab settings and differ only in small, arbitrary ways. The differences stem...
Tag: training
Here’s why Artificial Intelligence is so power-hungry
Artificial intelligence is getting more expensive to develop, and the cost is growing faster than the energy efficiency of the models. This is because they are trained many times with different structures, and the best one is selected. For example a model called Bidirectional Encoder Representations from Transformers (BERT) used 3.3 billion words from English books...
