Sign in

Topic

ai

A collection of 8 issues

What is AGI and Super-intelligence

I’ve come across technologists in two different camps: Camp A talks about AGI like a milestone: “AGI will be achieved”, or that “No way will we achieve AGI with current algorithms”. Camp B considers AGI or Superintelligence as an ill-defined term, therefore purely a marketing play. I want to

Coding Assistant AI across large codebases

I was surprised to find that Github Copilot still doesn't support answering questions over your entire codebase through @workspace /explain command. This feature seems to be part of their roadmap. It got me thinking what the real challenges are behind scaling reasoning across entire codebase given that they

Reinforcement Learning and RLHF in a nutshell

A very high-level summary of RL. Dall-e's somewhat inaccurate representation of RL state-space RL is an approach to efficiently search state-space of a well-defined system. We can think of the system as a graph with states (vertex) and actions (edges) that lead to change in state. In its

Reasoning in LLMs

I've been thinking about reasoning abilities in LLMs. To what degree do they exhibit reasoning abilities vs reformulation via statistical patterns? After all, they are increasingly referred to as "reasoning-engines" these days, but do they reason? I also came across an interesting post that solidified some

Transformers - Part 1 NLP

Transformer architectures have unlocked tremendous potential in the context of Machine Learning problems. It has become the basic building block for learning and generating all modalities: language, vision, speech. But what changed with Transformers? We had kernel methods available for decades. In short, transformers allows for efficient context-aware learning. A

Progress on LLMs

The field of NLP has made tremendous progress in last 10 years. These Deep Learning approaches, from Word2Vec to GPT4, show remarkable capabilities can be achieved through representation learning. Tracing the journey back 5 years shows progress has mostly been to scale and engineer these LLMs on data and compute.

What changed in AI?

2022 was a remarkable year for the field of Machine Learning AI as years of landmark research ideas culminated into applications with strong PMF. Image generation and dialog systems surpassed most of our expectations, shifting near-term upper-bound on coherence and reasoning abilities of these approaches. Products like Stable Diffusion, Midjourney,

PyTorch Design Philosophy

This is an ongoing note around Pytorch and its quirks. PyTorch is a library for Neural Net model building using Python. It provides: a) an array-based programming model, known as Tensors b) an automatic differentiation engine, utilizing the chain-rule of differentiation c) hardware acceleration through cuDNN, parallelization, and graph optimizers