English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

To pursue the goal of creating an open-ended agent in Minecraft, anopen-ended game environment with unlimited possibilities, this paper introducesa task-centric framework named MCU for Minecraft agent evaluation. The MCUframework leverages the concept of atom tasks as fundamental building blocks,enabling the generation of diverse or even arbitrary tasks. Within the MCUframework, each task is measured with six distinct difficulty scores (timeconsumption, operational effort, planning complexity, intricacy, creativity,novelty). These scores offer a multi-dimensional assessment of a task fromdifferent angles, and thus can reveal an agent's capability on specific facets.The difficulty scores also serve as the feature of each task, which creates ameaningful task space and unveils the relationship between tasks. For efficientevaluation of Minecraft agents employing the MCU framework, we maintain aunified benchmark, namely SkillForge, which comprises representative tasks withdiverse categories and difficulty distribution. We also provide convenientfilters for users to select tasks to assess specific capabilities of agents. Weshow that MCU has the high expressivity to cover all tasks used in recentliterature on Minecraft agent, and underscores the need for advancements inareas such as creativity, precise control, and out-of-distributiongeneralization under the goal of open-ended Minecraft agent development.

MCU: A Task-centric Framework for Open-ended Agent Evaluation in Minecraft