English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

This paper presents a comprehensive evaluation of the code generationcapabilities of ChatGPT, a prominent large language model, compared to humanprogrammers. A novel dataset of 131 code-generation prompts across 5 categorieswas curated to enable robust analysis. Code solutions were generated by bothChatGPT and humans for all prompts, resulting in 262 code samples. A meticulousmanual assessment methodology prioritized evaluating correctness,comprehensibility, and security using 14 established code quality metrics. Thekey findings reveal ChatGPT's strengths in crafting concise, efficient codewith advanced constructs, showcasing strengths in data analysis tasks (93.1%accuracy) but limitations in visual-graphical challenges. Comparative analysiswith human code highlights ChatGPT's inclination towards modular design andsuperior error handling. Additionally, machine learning models effectivelydistinguished ChatGPT from human code with up to 88% accuracy, suggestingdetectable coding style disparities. By providing profound insights intoChatGPT's code generation capabilities and limitations through quantitativemetrics and qualitative analysis, this study makes valuable contributionstoward advancing AI-based programming assistants. The curated dataset andmethodology offer a robust foundation for future research in this nascentdomain. All data and codes are available onhttps://github.com/DSAatUSU/ChatGPT-promises-and-pitfalls.

Assessing the Promise and Pitfalls of ChatGPT for Automated Code Generation