Ugrás a tartalomra

AI hírek, hogy ne maradj le

2026. október 28., szerda · frissítve 22:52
Vissza a hírekhez
OpenAI2026. okt. 19. 14:00modell

Sokkal jobban kezelik a ritkább programnyelveket az új GPT-6 modellek

Az OpenAI jelentős előrelépést ért el a COBOL, a Fortran és más ritkább nyelvek kódolásában és modernizálásában.

0
Advancing coding in low‑resource programming languages

Az OpenAI közzétette a MultiLangBench nevű új értékelési keretrendszert és a COBOL-migrációs tesztjeinek eredményeit. A fejlesztés célja, hogy az AI-modellek hatékonyabban segítsék a ritkább vagy régebbi programnyelvek, például a COBOL, a Fortran és a Visual Basic karbantartását és kódátírását, amelyek a mai napig kritikus infrastruktúrákat és pénzügyi rendszereket működtetnek.

A tesztek alapján a GPT-6 Astra 87,4 százalékos átlagos sikerességi arányt ért el 20 különböző programnyelven egy teljes adatbázis-motor megépítése során, szemben a GPT-5.6 Sol 26,8 százalékos eredményével. A COBOL-kódok modern nyelvekre (például C++, Java, Python vagy Rust) történő átültetésénél a GPT-6.1 Sol magas gondolkodási beállítás mellett 97,9 százalékos pontosságot mutatott.

Az OpenAI a nyílt forráskódú MultiLangBench tesztkészletet elérhetővé tette a GitHubon. A továbbfejlesztett kódolási képességekkel rendelkező új modellek a fejlesztői API-n keresztül már kipróbálhatók.

Az eredeti szöveg (OpenAI)
Our latest model advances bring stronger capabilities for building and migrating software in low-resource programming languages such as COBOL, Fortran, and Visual Basic. These languages have less code and documentation available for models to learn from than languages like Python and JavaScript, yet support critical infrastructure and essential services around the world. COBOL supports⁠(opens in a new window) more than 40% of online banking systems, 80% of in-person credit card transactions and 95% of ATM transactions, while Fortran is used in weather forecasting⁠(opens in a new window) and nuclear reactor safety analysis⁠(opens in a new window). Improving AI’s ability to work in these languages could help teams maintain and modernize the software that essential services depend on. This work is guided by feedback from developers and enterprise customers who have told us that coding models often struggle with these languages. Maintaining and modernizing this software can be difficult: documentation may be incomplete, original developers may have left the company, and important business rules may only exist in code. Whether teams are fixing bugs or migrating to another language, they need to preserve the behavior their systems depend on. To measure progress, we developed two evaluations. MultiLangBench tests whether a model can build a SQLite-compatible database engine from scratch across 20 different programming languages. Our COBOL migration evaluation tests whether a model can migrate existing programs to another language while preserving their behavior. Together, they test two complementary skills: building new software and preserving what existing software does. Our latest models show substantial improvements across both evaluations, delivering much higher accuracy at lower cost. On MultiLangBench, GPT‑6 Astra achieves an average test pass rate of 87.4% across 20 programming languages, up from 26.8% for GPT‑5.6 Sol, with improvements in every language tested. GPT‑6 Luna also outperforms GPT‑5.6 Sol, reaching 40.3% at approximately 78% lower estimated API cost. On our COBOL migration evaluation, GPT‑6.1 Sol achieves 86.6% accuracy at low reasoning effort, compared with just 5.4% for GPT‑5.6 Sol, while costing 39% less. At higher reasoning effort, accuracy reaches 97.9%, nearly saturating the evaluation. Together, these results show that our models are becoming significantly better at working with a wide range of programming languages, while also becoming more cost-efficient. MultiLangBench asks a model to build a SQLite-compatible database engine in a specified programming language. The model must organize a codebase, manage state, handle errors, and add new features while preserving existing functionality. To compare implementations across languages, we use database files as a shared interface. The candidate program receives an initial database and a SQL query, then produces a modified database. We use the reference SQLite implementation to check whether the resulting database has the expected contents. This lets us apply the same tests regardless of the language used to build the engine. We adapted tests from SQLite’s existing test suite to this format. The evaluation measures how much working functionality a model can build over an extended coding session, reporting both test pass rate and API cost. At maximum reasoning effort, GPT‑6 Astra achieves an average test pass rate of 87.4% across the 20 languages, up from 26.8% for GPT‑5.6 Sol. Improvements extend to every language tested, including COBOL (10.9% to 72.1%), OCaml (25.6% to 85.8%), Fortran (21.4% to 83.5%), and Visual Basic (27.5% to 89.4%). Astra scores above 83% in 19 of the 20 languages, with COBOL remaining the hardest at 72%. GPT‑6 Luna offers a lower-cost option that also improves on GPT‑5.6 Sol in every language tested. At maximum reasoning effort, it reaches an average test pass rate of 40.3%. Gains include COBOL (10.9% to 17.1%), OCaml (25.6% t

Az oldal magától nem használ sütit. A hozzájárulásoddal a látogatottságot a Google Analytics, a Facebook-hirdetéseink eredményét a Meta pixel méri. Részletek