Babbage conceives the Analytical Engine
In 1834, Charles Babbage conceived a programmable general-purpose computing engine, later called the Analytical Engine.
How artificial intelligence evolved: from scientific foundations to modern capabilities.
Last published:
Found: 141
Before 1900
For centuries, philosophers, mathematicians, and inventors explored the possibility of creating thinking machines. Advances in formal logic, mechanical computing devices, and early programming concepts laid the foundation for artificial intelligence.
In 1834, Charles Babbage conceived a programmable general-purpose computing engine, later called the Analytical Engine.
In 1843, Ada Lovelace published notes describing a sequence of operations for computing Bernoulli numbers on the proposed Analytical Engine. She also considered operations on other objects whose relationships could be expressed in a suitable formal representation.
George Boole presented an algebraic approach to logic, allowing propositions and arguments to be analyzed through equations.
Gottlob Frege presented a formal language of relations and quantification with an axiomatic calculus. It allowed reasoning with nested quantifiers to be expressed explicitly.
1900–1942
Advances in mathematical logic and computation theory established the scientific foundations of AI. Researchers began exploring the capabilities of algorithms, the principles of computation, and the limits of what machines could solve.
Karl Pearson formulated principal component analysis (PCA) as approximating data through projections that minimize the sum of squared errors.
In Animal Intelligence: Experimental Studies, Thorndike presented the law of effect: satisfaction or discomfort accompanying or closely following a response changes its likelihood of recurring in the same situation.
In his 1920 paper, Skolem uses functions that select witnesses for each tuple of universally quantified variables in a proof of satisfiability over a finite or countably infinite domain.
In September 1924, Mathematische Annalen published Schönfinkel’s paper on eliminating bound variables using combinators.
Herbrand showed that an entailment from a first-order knowledge base can be proved using a finite subset of its ground instances.
Gödel published a proof of completeness for first-order logic: every logically valid formula has a formal proof.
Church’s paper “A Set of Postulates for the Foundation of Logic” appeared in Annals of Mathematics. It described a logical system using lambda notation to represent sets.
Gerhard Gentzen developed natural deduction and sequent calculus and proved the cut-elimination theorem.
Turing described a machine capable of reading encoded descriptions of other machines and reproducing their computations.
Fisher used iris data in his work on discriminant analysis and introduced the term discriminant function.
In 1940, Alonzo Church presented a formulation of simple type theory with functions as primitive objects and lambda notation as its sole variable-binding mechanism.
1943–1955
Mathematical models of artificial neurons emerge alongside early research into machine learning. Advances in cybernetics and computing technology open new possibilities for creating systems capable of simulating aspects of human thought.
In December 1943, Warren McCulloch and Walter Pitts published a logical account of neural networks. They showed how to construct networks that realize logical expressions under specified conditions.
In The Organization of Behavior (1949), Donald Hebb proposed that a neuron’s repeated or persistent participation in firing another neuron increases its effectiveness in doing so.
Metropolis and Ulam presented a statistical approach to difficult computations: examining a random sample of trials or trajectories instead of calculating every possibility.
In Computing Machinery and Intelligence, Turing proposed replacing the question “Can machines think?” with a game in which an interrogator judges a machine's written answers.
Shannon published a chess-program design combining position evaluation with minimax move selection. He also described selective search as a way to reduce enumeration.
Metropolis and colleagues described sampling configurations from the Boltzmann distribution through random particle displacements with acceptance or rejection of proposed moves.
Martin Davis implemented Presburger's decision procedure in a program that performed an automated proof.
On January 7, 1954, IBM and Georgetown University publicly demonstrated automatic translation of Russian sentences into English on an IBM 701.
In September 1954, B. G. Farley and W. A. Clark published a study of a digitally simulated self-organizing network. Starting from a random initial state, it learned to distinguish two fixed input patterns by changing connection weights.
Arthur Prior published the first study of his tense logic, introducing future-time operators into propositional calculus.
The proposal dated August 31, 1955 outlined a shared research program in artificial intelligence. It initiated the 1956 Dartmouth summer research project.
According to Newell and Simon, the first successful hand simulation of a theorem proof using methods later incorporated into Logic Theorist took place on December 15, 1955.
1956–1973
Artificial intelligence emerges as a distinct scientific discipline. Early programs capable of logical reasoning, problem-solving, and natural language interaction inspire a wave of optimism about the future of intelligent machines.
In 1956, Logic Theorist became a working program for proving theorems in symbolic logic.
In 1956, a small group of scientists gathered for the Dartmouth Summer Research Project on Artificial Intelligence. The meeting was a seminal event in the emergence of AI as a research field.
Newell, Shaw, and Simon studied a chess program that used a game-tree pruning method.
Other things being equal, satisfaction strengthens the connection between a response and a situation, while discomfort weakens it. In Thorndike’s formulation, the degree of strengthening or weakening depends on the magnitude of satisfaction or discomfort.
The connection to AI is documented in reinforcement learning: Andrew Barto describes changes to action probabilities in actor–critic as implementing a version of the law of effect, citing Thorndike’s 1911 work.
Animal Intelligence | Project Gutenberg *** START OF THE PROJECT GUTENBERG EBOOK 69904 *** [i] ANIMAL INTELLIGENCE [ii] THE MACMILLAN COMPANY NEW YORK · BOSTON · CHICAGO SAN FRANCISCO MACMILLAN & CO., Limited LONDON · BOMBAY · CALCUTTA MELBOURNE THE MACMILLAN CO. OF CANADA, Ltd. TORONTO [iii] ANIMAL INTELLIGENCE EXPERIMENTAL STUDIES BY EDWARD L. THORNDIKE TEACHERS COLLEGE, COLUMBIA UNIVERSITY New York THE MACMILLAN COMPANY 1911 All rights reserved [iv] Copyright, 1911, By THE MACMILLAN COMPANY.
equal, be more firmly connected with the situation, so that, when it recurs, they will be more likely to recur; those which are accompanied or closely followed by discomfort to the animal will, other things being equal, have their connections with that situation weakened, so that, when it recurs, they will be less likely to occur. The greater the satisfaction or discomfort, the greater the strengthening or weakening of the bond. The Law of Exercise is that: Any response to a situation will, othe
that it leads to a next state with a value higher (lower) than that of s, both state values being estimated by the critic. Upon receiving this evaluation, the actor updates the policy by making a good action more likely to be selected upon revisiting s, or a bad action less likely, thus implementing a version of Edward Thorndike’s famous “Law of Effect” (Thorndike 1911). The critic component then updates its value function estimate using a temporal difference learning algorithm of the kind descr
Sources last checked: