Papers
arxiv:2402.03049

EasyInstruct: An Easy-to-use Instruction Processing Framework for Large Language Models

Published on Feb 5, 2024
Authors:
,
,

Abstract

EasyInstruct is an open-source framework for instruction processing in LLMs, modularizing generation, selection, and prompting to enhance data quality and facilitate research.

In recent years, instruction tuning has gained increasing attention and emerged as a crucial technique to enhance the capabilities of Large Language Models (LLMs). To construct high-quality instruction datasets, many instruction processing approaches have been proposed, aiming to achieve a delicate balance between data quantity and data quality. Nevertheless, due to inconsistencies that persist among various instruction processing methods, there is no standard open-source instruction processing implementation framework available for the community, which hinders practitioners from further developing and advancing. To facilitate instruction processing research and development, we present EasyInstruct, an easy-to-use instruction processing framework for LLMs, which modularizes instruction generation, selection, and prompting, while also considering their combination and interaction. EasyInstruct is publicly released and actively maintained at https://github.com/zjunlp/EasyInstruct, along with a running demo App at https://huggingface.co/spaces/zjunlp/EasyInstruct for quick-start, calling for broader research centered on instruction data.

Community

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2402.03049
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2402.03049 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2402.03049 in a dataset README.md to link it from this page.

Spaces citing this paper 1

Collections including this paper 1