{"id":905101,"date":"2025-12-10T15:04:41","date_gmt":"2025-12-10T22:04:41","guid":{"rendered":"https:\/\/www.myconstructionexpert.com\/blog\/?p=905101"},"modified":"2025-12-17T12:08:16","modified_gmt":"2025-12-17T19:08:16","slug":"large-language-models-where-they-fail-where-they-shine","status":"publish","type":"post","link":"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/","title":{"rendered":"LLMs in Construction: Where They Fail and Where They Shine"},"content":{"rendered":"\n

Aarni Heiskanen | AEC Business<\/a><\/p>\n\n\n\n

At the Building 2030 Summer Seminar, doctoral researchers Tuomas Valkonen<\/a> and Roope Nyqvist<\/a> from Aalto University shared fresh insights into how Large Language Models<\/a> (LLMs) like ChatGPT and DeepSeek perform in construction-related tasks.<\/p>\n\n\n\n

The results highlight a simple truth: used wisely, LLMs can accelerate knowledge work; used unwisely, they can produce nonsensical results in areas where precision is critical.<\/p>\n\n\n\n

HVAC systems descriptions with an LLM<\/h4>\n\n\n\n

Tuomas Valkonen shared his experiences using ChatGPT without any customization as a helper for MEP designers.<\/p>\n\n\n\n

First, Tuomas prompted GPT-4o and DeepSeek to do an HVAC systems description: \u201cI am an HVAC designer, and I\u2019m designing a residential apartment building. The building is heated with district heating and hydronic underfloor heating, with apartment-specific ventilation units. Prepare a systems description of all HVAC systems for me.\u201d<\/p>\n\n\n\n

Both LLMs created a \u201cmoderately reasonable\u201d systems description, but DeepSeek missed two essential systems in its output.<\/p>\n\n\n\n

Using PDFs as input for system design<\/h4>\n\n\n\n

Next, Tuomas explained how he provided ChatGPT and DeepSeek with a simplified hospital floor plan showing patient rooms. He asked the LLMs to create a ventilation zoning table for the plan without giving additional instructions about the systems.<\/p>\n\n\n\n

Both software programs offered a version with a different number of zones and air volumes.<\/p>\n\n\n\n

Tuomas also asked the LLMs to create an HVAC systems schema on top of the floor plan, and ChatGPT to color-code the service zones of an actual plan from a real project. The results were nonsensical. DeepSeek even instructed you to use Microsoft Paint to do the coloring yourself!<\/p>\n\n\n\n

Quantity takeoffs, way off<\/h4>\n\n\n\n

Trying to create a room schedule from the plan drawing did not go well either. The plan had 72 rooms, totaling 832 square meters. ChatGPT found 30 rooms covering 313 sqm.<\/p>\n\n\n\n

Furthermore, calculating the room-specific heating load or calculating quantities resulted in several errors. ChatGPT failed to correctly perform a simple multiplication on one line, and it suggested that a duct segment in one apartment was two kilometers long.<\/p>\n\n\n\n

Eventually, after several iterations, Tuomas started getting better results. He believes that with proper instructions, a quantity takeoff with this technology would become feasible and more reliable.<\/p>\n\n\n\n

Assessing IFC file data quality<\/h4>\n\n\n\n

Tuomas also tested how well ChatGPT could check whether an MEP IFC file included the mandatory information.<\/p>\n\n\n\n

Initially, ChatGPT could not read the IFC as-is, but created a piece of software that turned it into a text file it could use.<\/p>\n\n\n\n

After a few trials and errors, he discovered a method to obtain the correct results with a model having 5,000 components. A model with 50,000 components, however, proved to be too large. In that case, ChatGPT could create Python code to do the job.<\/p>\n\n\n\n

Where do LLMs shine?<\/h4>\n\n\n\n

As Tuomas\u2019s tests demonstrate, out-of-the-box LLMs can\u2019t be reliable assistants in many common construction tasks that deal with graphical information and understanding of construction concepts. However, they shine in some other applications.<\/p>\n\n\n\n

Roope Nyqvist discussed use cases where LLMs proved helpful. He had, for example, developed a custom GPT that can answer questions about hospital design. The knowledge base<\/a> incorporates 6,543 files, covering 1,749 pages of expert knowledge, into a system available for anyone to use. It took only 100 hours to create the tool.<\/p>\n\n\n\n

LLMs also excel at creating clear RFIs, change orders, meeting summaries, or client-friendly reports. They can convert complex technical content into straightforward language or translate between languages for international project teams.<\/p>\n\n\n\n

In bids and proposals, LLMs accelerate narrative writing, case study creation, and market research. They are already proving useful in helping contractors tell their story more effectively and quickly.<\/p>\n\n\n\n

Specialized tools rule<\/h4>\n\n\n\n

It\u2019s clear that domain-specific models are essential when accuracy and reliability are necessary. LLMs won\u2019t replace Togal, Buildots, Kreo<\/em>, and similar tools, but they will communicate with them.<\/p>\n\n\n\n

ChatGPT is most reliable in language-heavy, reasoning-heavy, low-liability tasks: communication, documentation, learning, project support, and orchestration. And even then, ask it: \u201cAre you sure?\u201d<\/p>\n\n\n\n

\n\n\n\n

When one of your cases is in need of a construction expert, estimates, insurance appraisal or umpire services in defect or insurance disputes – please call Advise & Consult, Inc. at 888.684.8305, or email experts@adviseandconsult.net<\/a>.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

Aarni Heiskanen | AEC Business At the Building 2030 Summer Seminar, doctoral researchers Tuomas Valkonen and Roope Nyqvist from Aalto University shared fresh insights into how Large Language Models (LLMs) like ChatGPT and DeepSeek perform in construction-related tasks. The results highlight a simple truth: used wisely, LLMs can accelerate knowledge work; used unwisely, they can produce nonsensical results in… Continue reading LLMs in Construction: Where They Fail and Where They Shine<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[14],"tags":[9895,11331,12,12264],"class_list":["post-905101","post","type-post","status-publish","format-standard","hentry","category-construction-2","tag-advise-consult","tag-artificial-intelligence","tag-construction","tag-large-language-models","entry"],"jetpack_publicize_connections":[],"yoast_head":"\nLLMs in Construction: Where They Fail and Where They Shine - Advise & Consult, Inc.<\/title>\n<meta name=\"description\" content=\"fresh insights into how Large Language Models (LLMs) like ChatGPT and DeepSeek perform in construction-related tasks\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"LLMs in Construction: Where They Fail and Where They Shine - Advise & Consult, Inc.\" \/>\n<meta property=\"og:description\" content=\"fresh insights into how Large Language Models (LLMs) like ChatGPT and DeepSeek perform in construction-related tasks\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/\" \/>\n<meta property=\"og:site_name\" content=\"Advise & Consult, Inc.\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Advise-Consult-Inc-126949043996790\/\" \/>\n<meta property=\"article:published_time\" content=\"2025-12-10T22:04:41+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-17T19:08:16+00:00\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@adviseconsult\" \/>\n<meta name=\"twitter:site\" content=\"@adviseconsult\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/#\/schema\/person\/0a11abe008083d5fb19c2b0feefe7bd7\"},\"headline\":\"LLMs in Construction: Where They Fail and Where They Shine\",\"datePublished\":\"2025-12-10T22:04:41+00:00\",\"dateModified\":\"2025-12-17T19:08:16+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/\"},\"wordCount\":703,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/#organization\"},\"keywords\":[\"Advise & Consult\",\"Artificial Intelligence\",\"construction\",\"Large Language Models\"],\"articleSection\":[\"Construction\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/\",\"url\":\"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/\",\"name\":\"LLMs in Construction: Where They Fail and Where They Shine - Advise & Consult, Inc.\",\"isPartOf\":{\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/#website\"},\"datePublished\":\"2025-12-10T22:04:41+00:00\",\"dateModified\":\"2025-12-17T19:08:16+00:00\",\"description\":\"fresh insights into how Large Language Models (LLMs) like ChatGPT and DeepSeek perform in construction-related tasks\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/#website\",\"url\":\"https:\/\/www.myconstructionexpert.com\/blog\/\",\"name\":\"Advise & Consult, Inc.\",\"description\":\"Construction Expert Witnesses\",\"publisher\":{\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.myconstructionexpert.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/#organization\",\"name\":\"Advise & Consult\",\"url\":\"https:\/\/www.myconstructionexpert.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.myconstructionexpert.com\/blog\/wp-content\/uploads\/2015\/11\/AC-Red-Logo.png\",\"contentUrl\":\"https:\/\/www.myconstructionexpert.com\/blog\/wp-content\/uploads\/2015\/11\/AC-Red-Logo.png\",\"width\":162,\"height\":75,\"caption\":\"Advise & Consult\"},\"image\":{\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/Advise-Consult-Inc-126949043996790\/\",\"https:\/\/x.com\/adviseconsult\",\"https:\/\/www.linkedin.com\/company-beta\/204526\/\",\"https:\/\/www.youtube.com\/user\/MrConstructionExpert\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/#\/schema\/person\/0a11abe008083d5fb19c2b0feefe7bd7\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.myconstructionexpert.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/b01e71b7acadd7657af782b7ad1a30cc?s=96&d=mm&r=pg\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/b01e71b7acadd7657af782b7ad1a30cc?s=96&d=mm&r=pg\",\"caption\":\"admin\"},\"sameAs\":[\"http:\/\/www.expertwitnessinconstruction.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"LLMs in Construction: Where They Fail and Where They Shine - Advise & Consult, Inc.","description":"fresh insights into how Large Language Models (LLMs) like ChatGPT and DeepSeek perform in construction-related tasks","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/","og_locale":"en_US","og_type":"article","og_title":"LLMs in Construction: Where They Fail and Where They Shine - Advise & Consult, Inc.","og_description":"fresh insights into how Large Language Models (LLMs) like ChatGPT and DeepSeek perform in construction-related tasks","og_url":"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/","og_site_name":"Advise & Consult, Inc.","article_publisher":"https:\/\/www.facebook.com\/Advise-Consult-Inc-126949043996790\/","article_published_time":"2025-12-10T22:04:41+00:00","article_modified_time":"2025-12-17T19:08:16+00:00","author":"admin","twitter_card":"summary_large_image","twitter_creator":"@adviseconsult","twitter_site":"@adviseconsult","twitter_misc":{"Written by":"admin","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/#article","isPartOf":{"@id":"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/"},"author":{"name":"admin","@id":"https:\/\/www.myconstructionexpert.com\/blog\/#\/schema\/person\/0a11abe008083d5fb19c2b0feefe7bd7"},"headline":"LLMs in Construction: Where They Fail and Where They Shine","datePublished":"2025-12-10T22:04:41+00:00","dateModified":"2025-12-17T19:08:16+00:00","mainEntityOfPage":{"@id":"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/"},"wordCount":703,"commentCount":0,"publisher":{"@id":"https:\/\/www.myconstructionexpert.com\/blog\/#organization"},"keywords":["Advise & Consult","Artificial Intelligence","construction","Large Language Models"],"articleSection":["Construction"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/","url":"https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/","name":"LLMs in Construction: Where They Fail and Where They Shine - Advise & Consult, Inc.","isPartOf":{"@id":"https:\/\/www.myconstructionexpert.com\/blog\/#website"},"datePublished":"2025-12-10T22:04:41+00:00","dateModified":"2025-12-17T19:08:16+00:00","description":"fresh insights into how Large Language Models (LLMs) like ChatGPT and DeepSeek perform in construction-related tasks","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.myconstructionexpert.com\/blog\/large-language-models-where-they-fail-where-they-shine\/"]}]},{"@type":"WebSite","@id":"https:\/\/www.myconstructionexpert.com\/blog\/#website","url":"https:\/\/www.myconstructionexpert.com\/blog\/","name":"Advise & Consult, Inc.","description":"Construction Expert Witnesses","publisher":{"@id":"https:\/\/www.myconstructionexpert.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.myconstructionexpert.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.myconstructionexpert.com\/blog\/#organization","name":"Advise & Consult","url":"https:\/\/www.myconstructionexpert.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.myconstructionexpert.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.myconstructionexpert.com\/blog\/wp-content\/uploads\/2015\/11\/AC-Red-Logo.png","contentUrl":"https:\/\/www.myconstructionexpert.com\/blog\/wp-content\/uploads\/2015\/11\/AC-Red-Logo.png","width":162,"height":75,"caption":"Advise & Consult"},"image":{"@id":"https:\/\/www.myconstructionexpert.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Advise-Consult-Inc-126949043996790\/","https:\/\/x.com\/adviseconsult","https:\/\/www.linkedin.com\/company-beta\/204526\/","https:\/\/www.youtube.com\/user\/MrConstructionExpert"]},{"@type":"Person","@id":"https:\/\/www.myconstructionexpert.com\/blog\/#\/schema\/person\/0a11abe008083d5fb19c2b0feefe7bd7","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.myconstructionexpert.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/b01e71b7acadd7657af782b7ad1a30cc?s=96&d=mm&r=pg","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b01e71b7acadd7657af782b7ad1a30cc?s=96&d=mm&r=pg","caption":"admin"},"sameAs":["http:\/\/www.expertwitnessinconstruction.com"]}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p2ztG6-3Nsp","jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/www.myconstructionexpert.com\/blog\/wp-json\/wp\/v2\/posts\/905101","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.myconstructionexpert.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.myconstructionexpert.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.myconstructionexpert.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.myconstructionexpert.com\/blog\/wp-json\/wp\/v2\/comments?post=905101"}],"version-history":[{"count":2,"href":"https:\/\/www.myconstructionexpert.com\/blog\/wp-json\/wp\/v2\/posts\/905101\/revisions"}],"predecessor-version":[{"id":905165,"href":"https:\/\/www.myconstructionexpert.com\/blog\/wp-json\/wp\/v2\/posts\/905101\/revisions\/905165"}],"wp:attachment":[{"href":"https:\/\/www.myconstructionexpert.com\/blog\/wp-json\/wp\/v2\/media?parent=905101"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.myconstructionexpert.com\/blog\/wp-json\/wp\/v2\/categories?post=905101"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.myconstructionexpert.com\/blog\/wp-json\/wp\/v2\/tags?post=905101"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}