Questions about Neural network (machine learning)

Short answers, pulled from the story.

When was the method of least squares published by Adrien-Marie Legendre?

Adrien-Marie Legendre published the method of least squares in 1805 to find a rough linear fit for planetary movement data. This statistical technique became the foundation for what would eventually be called artificial neural networks over two centuries later.

Who introduced backpropagation and when did Seppo Linnainmaa publish its modern form?

Rosenblatt introduced the terminology back-propagating errors in 1962 but did not know how to implement it. Seppo Linnainmaa published the modern form of backpropagation in his Master's thesis on the 1st of September 1970.

Which researchers won the ImageNet competition in October 2012 with AlexNet?

Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton won the large-scale ImageNet competition in October 2012 with AlexNet. This network achieved superhuman performance in visual pattern recognition for the first time outperforming traditional methods by a factor of three.

What year did Jürgen Schmidhuber publish Attention Is All You Need leading to the Transformer architecture?

Jürgen Schmidhuber published Attention Is All You Need in 2014 leading to the modern Transformer architecture. These models require computation time that is quadratic in the size of the context window and are used today by many large language models such as ChatGPT GPT-4 and BERT.

How do neural networks diagnose cancer according to the provided script text?

Artificial neural networks diagnose several types of cancers by distinguishing highly invasive cancer cell lines using only cell shape information. They also accelerate reliability analysis of infrastructures subject to natural disasters and predict foundation settlements.

Read the full story about Neural network (machine learning) →

Up Next

Feedforward neural network Deep learning Machine learning