Hardware

Kinda of amazing how consumer and enterprise chips are starting to rival the performance capability required to stimulant the human brain.

The recently Nvidia H100 is capable of one thousand trillion BFLOAT16 Tensor Core, and two thousand trillion INT8 Tensor Core operations a second. Upcoming generations of consumer and enterprise Nvidia chip over the forthcoming decade should transfer this speed into mainstream market, and further improve it.

The human brain has about sixty to hundred billion neurons, and two hundred to four hundred trillion synapses. Only between 8-16% of the human brain is active at one time, with a firing rate of between 10-40 hz a second. Furthermore, large parts of the human brain are involved in tasks unrelated to higher cognitive processors, for instance the cerebellum contains ~80% of the brain's neurons in the manner of tightly packed granule cells, but has limited functionality when it comes to higher cognitive process.