DEEP LEARNING

  1. [Attention Is All You Need] (Transformers) - a neural network architecture that uses only attention mechanisms—abandoning recurrence and convolution—to enable fast, parallel, and state-of-the-art performance in tasks like machine translation and language modeling. This paper revolutionized AI by enabling models to efficiently capture relationships between all sequence elements, forming the backbone of today’s generative language models

  2. [ImageNet Classification with Deep Convolutional Neural Networks] (Alexnet) - AlexNet is a deep convolutional neural network introduced in 2012 that won the ImageNet competition by using innovations like ReLU activation for faster training, dropout for reducing overfitting, overlapping pooling, and GPU parallelism. It drastically improved image recognition accuracy and sparked the deep learning revolution in computer vision.

MACHINE LEARNING