Babbage conceives the Analytical Engine
In 1834, Charles Babbage conceived a programmable general-purpose computing engine, later called the Analytical Engine.
How artificial intelligence evolved: from scientific foundations to modern capabilities.
Last published:
Found: 141
Before 1900
For centuries, philosophers, mathematicians, and inventors explored the possibility of creating thinking machines. Advances in formal logic, mechanical computing devices, and early programming concepts laid the foundation for artificial intelligence.
In 1834, Charles Babbage conceived a programmable general-purpose computing engine, later called the Analytical Engine.
In 1843, Ada Lovelace published notes describing a sequence of operations for computing Bernoulli numbers on the proposed Analytical Engine. She also considered operations on other objects whose relationships could be expressed in a suitable formal representation.
George Boole presented an algebraic approach to logic, allowing propositions and arguments to be analyzed through equations.
Gottlob Frege presented a formal language of relations and quantification with an axiomatic calculus. It allowed reasoning with nested quantifiers to be expressed explicitly.
1900–1942
Advances in mathematical logic and computation theory established the scientific foundations of AI. Researchers began exploring the capabilities of algorithms, the principles of computation, and the limits of what machines could solve.
Karl Pearson formulated principal component analysis (PCA) as approximating data through projections that minimize the sum of squared errors.
In Animal Intelligence: Experimental Studies, Thorndike presented the law of effect: satisfaction or discomfort accompanying or closely following a response changes its likelihood of recurring in the same situation.
In his 1920 paper, Skolem uses functions that select witnesses for each tuple of universally quantified variables in a proof of satisfiability over a finite or countably infinite domain.
In September 1924, Mathematische Annalen published Schönfinkel’s paper on eliminating bound variables using combinators.
Herbrand showed that an entailment from a first-order knowledge base can be proved using a finite subset of its ground instances.
Gödel published a proof of completeness for first-order logic: every logically valid formula has a formal proof.
Church’s paper “A Set of Postulates for the Foundation of Logic” appeared in Annals of Mathematics. It described a logical system using lambda notation to represent sets.
Gerhard Gentzen developed natural deduction and sequent calculus and proved the cut-elimination theorem.
Turing described a machine capable of reading encoded descriptions of other machines and reproducing their computations.
Fisher used iris data in his work on discriminant analysis and introduced the term discriminant function.
In 1940, Alonzo Church presented a formulation of simple type theory with functions as primitive objects and lambda notation as its sole variable-binding mechanism.
1943–1955
Mathematical models of artificial neurons emerge alongside early research into machine learning. Advances in cybernetics and computing technology open new possibilities for creating systems capable of simulating aspects of human thought.
In December 1943, Warren McCulloch and Walter Pitts published a logical account of neural networks. They showed how to construct networks that realize logical expressions under specified conditions.
In The Organization of Behavior (1949), Donald Hebb proposed that a neuron’s repeated or persistent participation in firing another neuron increases its effectiveness in doing so.
Metropolis and Ulam presented a statistical approach to difficult computations: examining a random sample of trials or trajectories instead of calculating every possibility.
In Computing Machinery and Intelligence, Turing proposed replacing the question “Can machines think?” with a game in which an interrogator judges a machine's written answers.
Shannon published a chess-program design combining position evaluation with minimax move selection. He also described selective search as a way to reduce enumeration.
Metropolis and colleagues described sampling configurations from the Boltzmann distribution through random particle displacements with acceptance or rejection of proposed moves.
Martin Davis implemented Presburger's decision procedure in a program that performed an automated proof.
On January 7, 1954, IBM and Georgetown University publicly demonstrated automatic translation of Russian sentences into English on an IBM 701.
In September 1954, B. G. Farley and W. A. Clark published a study of a digitally simulated self-organizing network. Starting from a random initial state, it learned to distinguish two fixed input patterns by changing connection weights.
Arthur Prior published the first study of his tense logic, introducing future-time operators into propositional calculus.
The proposal dated August 31, 1955 outlined a shared research program in artificial intelligence. It initiated the 1956 Dartmouth summer research project.
According to Newell and Simon, the first successful hand simulation of a theorem proof using methods later incorporated into Logic Theorist took place on December 15, 1955.
1956–1973
Artificial intelligence emerges as a distinct scientific discipline. Early programs capable of logical reasoning, problem-solving, and natural language interaction inspire a wave of optimism about the future of intelligent machines.
In 1956, Logic Theorist became a working program for proving theorems in symbolic logic.
In 1956, a small group of scientists gathered for the Dartmouth Summer Research Project on Artificial Intelligence. The meeting was a seminal event in the emergence of AI as a research field.
Newell, Shaw, and Simon studied a chess program that used a game-tree pruning method.
The paper discusses estimating the volume of a high-dimensional region and simulating chains of particle interactions. The authors explain how computing machines can carry out these procedures.
Random-sample estimates make it possible to approximate sums and integrals that cannot be computed exactly. The deep learning textbook documents widespread use of this approach in machine learning, including computations for training probabilistic models.
Sat Nov 17 07:03:49 2007 JOURNAL O F THE A M E R I C A N STATISTICAL ASSOCIATION Number 167 S E P T E M B E R 1949 Volume 44 T H E MONTE CARL0 METHOD METROPOLIS NICHOLAS AND S. ULAM Los Alamos Laboratory We shall present here the motivation and a general descrip- tion of a method dealing with a class of problems in mathe- matical physics. The method is, essentially, a statistical approach t o the study of differential equations, or more generally, of integro-differential equations that occur in
J Am Stat Assoc Actions Search in PubMed Search in NLM Catalog Add to Search . 1949 Sep;44(247):335-41. doi: 10.1080/01621459.1949.10483310. The Monte Carlo method N METROPOLIS, S ULAM PMID: 18139350 DOI: 10.1080/01621459.1949.10483310 Item in Clipboard The Monte Carlo method N METROPOLIS et al. J Am Stat Assoc. 1949 Sep. Show details Display options Display options Format Abstract PubMed PMID J Am Stat Assoc Actions Search in PubMed Search in NLM Catalog Add to Search . 1949 Sep;44(247):335-41.
deterministic approximate algorithms or Monte Carlo approximations. Both approaches are ubiquitous in machine learning. In this chapter, we focus on Monte Carlo methods. 17.1 Sampling and Monte Carlo Methods Many important technologies used to accomplish machine learning goals are based on drawing samples from some probability distribution and using these samples to form a Monte Carlo estimate of some desired quantity. 17.1.1 Why Sampling? We may wish to draw samples from a probability distribut
Sources last checked: