{"id":2991,"date":"2023-01-11T14:53:14","date_gmt":"2023-01-11T14:53:14","guid":{"rendered":"https:\/\/autogenai.dsstaging2.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/"},"modified":"2025-03-20T20:51:57","modified_gmt":"2025-03-20T20:51:57","slug":"wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra","status":"publish","type":"post","link":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/","title":{"rendered":"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra"},"content":{"rendered":"<p class=\"styles_paragraph__BUdL_\">The early Wittgenstein wrote in \u2018Tractatus Logico-Philosophicus\u2019, \u201cWhereof one cannot speak, thereof one must be silent.\u201d By the end of his career, Wittgenstein had come to realise that humans could, and did, play far more \u201clanguage-games\u201d than just communicating facts.<\/p>\n<p class=\"styles_paragraph__BUdL_\">The remarkable thing is not that ChatGPT writes sentences that are false, it is that it writes sentences that are true. Of course, this is just a happy accident. LLMs have no idea whether a sentence they write is true or false. They have no judgement. They put words in a grammatically satisfying order based on a complex soup of linear algebra. Sometimes the state of affairs that corresponds to those words attains and the sentence is true. Sometimes the state of affairs that corresponds to those words does not attain and the sentence is false. A lot of the time a sentence does not represent a state of affairs at all and is neither true nor false.<\/p>\n<p class=\"styles_paragraph__BUdL_\">LLMs are a great tool for producing grammatically correct word sequences very fast indeed. There are lots of use cases for this that will transform society. Most of these use cases will combine the power of LLMs with human judgement and checks.<\/p>\n<p class=\"styles_paragraph__BUdL_\">LLMs are a terrible tool for consistently producing truth. Criticising them for this is like criticising a lawn mower for not being able to compose music.<\/p>\n<p class=\"styles_paragraph__BUdL_\">The future of Large Language Models is software that takes the speed and sheer productivity of the machine and combines it with the innovation and judgement of a human.<\/p>\n<p class=\"styles_paragraph__BUdL_\">The early Wittgenstein wrote in \u2018Tractatus Logico-Philosophicus\u2019, \u201cWhereof one cannot speak, thereof one must be silent.\u201d By the end of his career, Wittgenstein had come to realise that humans could, and did, play far more \u201clanguage-games\u201d than just communicating facts.<\/p>\n<p class=\"styles_paragraph__BUdL_\">The remarkable thing is not that ChatGPT writes sentences that are false, it is that it writes sentences that are true. Of course, this is just a happy accident. LLMs have no idea whether a sentence they write is true or false. They have no judgement. They put words in a grammatically satisfying order based on a complex soup of linear algebra. Sometimes the state of affairs that corresponds to those words attains and the sentence is true. Sometimes the state of affairs that corresponds to those words does not attain and the sentence is false. A lot of the time a sentence does not represent a state of affairs at all and is neither true nor false.<\/p>\n<p class=\"styles_paragraph__BUdL_\">LLMs are a great tool for producing grammatically correct word sequences very fast indeed. There are lots of use cases for this that will transform society. Most of these use cases will combine the power of LLMs with human judgement and checks.<\/p>\n<p class=\"styles_paragraph__BUdL_\">LLMs are a terrible tool for consistently producing truth. Criticising them for this is like criticising a lawn mower for not being able to compose music.<\/p>\n<p class=\"styles_paragraph__BUdL_\">The future of Large Language Models is software that takes the speed and sheer productivity of the machine and combines it with the innovation and judgement of a human.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The early Wittgenstein wrote in \u2018Tractatus Logico-Philosophicus\u2019, \u201cWhereof one cannot speak, thereof one must be silent.\u201d By the end of his career, Wittgenstein had come to realise that humans could, and did, play far more \u201clanguage-games\u201d than just communicating facts. The remarkable thing is not that ChatGPT writes sentences that are false, it is that&#8230;<\/p>\n","protected":false},"author":161,"featured_media":2992,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"categories":[31],"tags":[],"class_list":["post-2991","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-case-studies"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra | AutogenAI APAC<\/title>\n<meta name=\"description\" content=\"Many of the criticisms of large language models (text generating AI) are based on a na\u00efve view of the function and purpose of language.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra | AutogenAI APAC\" \/>\n<meta property=\"og:description\" content=\"Many of the criticisms of large language models (text generating AI) are based on a na\u00efve view of the function and purpose of language.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/\" \/>\n<meta property=\"og:site_name\" content=\"AutogenAI APAC\" \/>\n<meta property=\"article:published_time\" content=\"2023-01-11T14:53:14+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-03-20T20:51:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/autogenai.com\/apac\/wp-content\/uploads\/sites\/5\/2025\/02\/Wittgenstein-ChatGPT-and-a-Complex-Soup-of-Linear-Algebra.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1920\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Sean Williams\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Sean Williams\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/\"},\"author\":{\"name\":\"Sean Williams\",\"@id\":\"https:\/\/autogenai.com\/apac\/#\/schema\/person\/3830bc602730d38e82bb11cba7dc9f76\"},\"headline\":\"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra\",\"datePublished\":\"2023-01-11T14:53:14+00:00\",\"dateModified\":\"2025-03-20T20:51:57+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/\"},\"wordCount\":519,\"image\":{\"@id\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/autogenai.com\/apac\/wp-content\/uploads\/sites\/5\/2025\/02\/Wittgenstein-ChatGPT-and-a-Complex-Soup-of-Linear-Algebra.jpg\",\"articleSection\":[\"Case Studies\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/\",\"url\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/\",\"name\":\"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra | AutogenAI APAC\",\"isPartOf\":{\"@id\":\"https:\/\/autogenai.com\/apac\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/autogenai.com\/apac\/wp-content\/uploads\/sites\/5\/2025\/02\/Wittgenstein-ChatGPT-and-a-Complex-Soup-of-Linear-Algebra.jpg\",\"datePublished\":\"2023-01-11T14:53:14+00:00\",\"dateModified\":\"2025-03-20T20:51:57+00:00\",\"author\":{\"@id\":\"https:\/\/autogenai.com\/apac\/#\/schema\/person\/3830bc602730d38e82bb11cba7dc9f76\"},\"description\":\"Many of the criticisms of large language models (text generating AI) are based on a na\u00efve view of the function and purpose of language.\",\"breadcrumb\":{\"@id\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#primaryimage\",\"url\":\"https:\/\/autogenai.com\/apac\/wp-content\/uploads\/sites\/5\/2025\/02\/Wittgenstein-ChatGPT-and-a-Complex-Soup-of-Linear-Algebra.jpg\",\"contentUrl\":\"https:\/\/autogenai.com\/apac\/wp-content\/uploads\/sites\/5\/2025\/02\/Wittgenstein-ChatGPT-and-a-Complex-Soup-of-Linear-Algebra.jpg\",\"width\":1920,\"height\":1080,\"caption\":\"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/autogenai.com\/apac\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/autogenai.com\/apac\/#website\",\"url\":\"https:\/\/autogenai.com\/apac\/\",\"name\":\"AutogenAI APAC\",\"description\":\"Win more business\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/autogenai.com\/apac\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/autogenai.com\/apac\/#\/schema\/person\/3830bc602730d38e82bb11cba7dc9f76\",\"name\":\"Sean Williams\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/5139b2de21b52dca734b6c2930dbb56221a07e4d501dcba0bb1f59c886e16a6e?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/5139b2de21b52dca734b6c2930dbb56221a07e4d501dcba0bb1f59c886e16a6e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/5139b2de21b52dca734b6c2930dbb56221a07e4d501dcba0bb1f59c886e16a6e?s=96&d=mm&r=g\",\"caption\":\"Sean Williams\"},\"url\":\"https:\/\/autogenai.com\/apac\/blog\/author\/sean_williams_e4a49907-3917-44b3-bcc0-cdb517fd50a3\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra | AutogenAI APAC","description":"Many of the criticisms of large language models (text generating AI) are based on a na\u00efve view of the function and purpose of language.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/","og_locale":"en_US","og_type":"article","og_title":"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra | AutogenAI APAC","og_description":"Many of the criticisms of large language models (text generating AI) are based on a na\u00efve view of the function and purpose of language.","og_url":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/","og_site_name":"AutogenAI APAC","article_published_time":"2023-01-11T14:53:14+00:00","article_modified_time":"2025-03-20T20:51:57+00:00","og_image":[{"width":1920,"height":1080,"url":"https:\/\/autogenai.com\/apac\/wp-content\/uploads\/sites\/5\/2025\/02\/Wittgenstein-ChatGPT-and-a-Complex-Soup-of-Linear-Algebra.jpg","type":"image\/jpeg"}],"author":"Sean Williams","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Sean Williams"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#article","isPartOf":{"@id":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/"},"author":{"name":"Sean Williams","@id":"https:\/\/autogenai.com\/apac\/#\/schema\/person\/3830bc602730d38e82bb11cba7dc9f76"},"headline":"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra","datePublished":"2023-01-11T14:53:14+00:00","dateModified":"2025-03-20T20:51:57+00:00","mainEntityOfPage":{"@id":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/"},"wordCount":519,"image":{"@id":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#primaryimage"},"thumbnailUrl":"https:\/\/autogenai.com\/apac\/wp-content\/uploads\/sites\/5\/2025\/02\/Wittgenstein-ChatGPT-and-a-Complex-Soup-of-Linear-Algebra.jpg","articleSection":["Case Studies"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/","url":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/","name":"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra | AutogenAI APAC","isPartOf":{"@id":"https:\/\/autogenai.com\/apac\/#website"},"primaryImageOfPage":{"@id":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#primaryimage"},"image":{"@id":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#primaryimage"},"thumbnailUrl":"https:\/\/autogenai.com\/apac\/wp-content\/uploads\/sites\/5\/2025\/02\/Wittgenstein-ChatGPT-and-a-Complex-Soup-of-Linear-Algebra.jpg","datePublished":"2023-01-11T14:53:14+00:00","dateModified":"2025-03-20T20:51:57+00:00","author":{"@id":"https:\/\/autogenai.com\/apac\/#\/schema\/person\/3830bc602730d38e82bb11cba7dc9f76"},"description":"Many of the criticisms of large language models (text generating AI) are based on a na\u00efve view of the function and purpose of language.","breadcrumb":{"@id":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#primaryimage","url":"https:\/\/autogenai.com\/apac\/wp-content\/uploads\/sites\/5\/2025\/02\/Wittgenstein-ChatGPT-and-a-Complex-Soup-of-Linear-Algebra.jpg","contentUrl":"https:\/\/autogenai.com\/apac\/wp-content\/uploads\/sites\/5\/2025\/02\/Wittgenstein-ChatGPT-and-a-Complex-Soup-of-Linear-Algebra.jpg","width":1920,"height":1080,"caption":"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra"},{"@type":"BreadcrumbList","@id":"https:\/\/autogenai.com\/apac\/blog\/wittgenstein-chatgpt-and-a-complex-soup-of-linear-algebra\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/autogenai.com\/apac\/"},{"@type":"ListItem","position":2,"name":"Wittgenstein, ChatGPT and a Complex Soup of Linear Algebra"}]},{"@type":"WebSite","@id":"https:\/\/autogenai.com\/apac\/#website","url":"https:\/\/autogenai.com\/apac\/","name":"AutogenAI APAC","description":"Win more business","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/autogenai.com\/apac\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/autogenai.com\/apac\/#\/schema\/person\/3830bc602730d38e82bb11cba7dc9f76","name":"Sean Williams","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/5139b2de21b52dca734b6c2930dbb56221a07e4d501dcba0bb1f59c886e16a6e?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/5139b2de21b52dca734b6c2930dbb56221a07e4d501dcba0bb1f59c886e16a6e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5139b2de21b52dca734b6c2930dbb56221a07e4d501dcba0bb1f59c886e16a6e?s=96&d=mm&r=g","caption":"Sean Williams"},"url":"https:\/\/autogenai.com\/apac\/blog\/author\/sean_williams_e4a49907-3917-44b3-bcc0-cdb517fd50a3\/"}]}},"_links":{"self":[{"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/posts\/2991","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/users\/161"}],"replies":[{"embeddable":true,"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/comments?post=2991"}],"version-history":[{"count":1,"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/posts\/2991\/revisions"}],"predecessor-version":[{"id":3711,"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/posts\/2991\/revisions\/3711"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/media\/2992"}],"wp:attachment":[{"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/media?parent=2991"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/categories?post=2991"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/autogenai.com\/apac\/wp-json\/wp\/v2\/tags?post=2991"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}