English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

We present the Chinese Elementary School Math Word Problems (CMATH) dataset,comprising 1.7k elementary school-level math word problems with detailedannotations, source from actual Chinese workbooks and exams. This dataset aimsto provide a benchmark tool for assessing the following question: to what gradelevel of elementary school math do the abilities of popular large languagemodels (LLMs) correspond? We evaluate a variety of popular LLMs, including bothcommercial and open-source options, and discover that only GPT-4 achievessuccess (accuracy $\geq$ 60\%) across all six elementary school grades, whileother models falter at different grade levels. Furthermore, we assess therobustness of several top-performing LLMs by augmenting the original problemsin the CMATH dataset with distracting information. Our findings reveal thatGPT-4 is able to maintains robustness, while other model fail. We anticipatethat our study will expose limitations in LLMs' arithmetic and reasoningcapabilities, and promote their ongoing development and advancement.

CMATH: Can Your Language Model Pass Chinese Elementary School Math Test?