parse

parse and pre-process openai traces

Load & Parse Data

ChatData helps you load and parse OpenAI jsonl data.

---

source

ChatData

 ChatData (data)

Process multi-turn chat data from openai.

_a_data = ChatData.load_jsonl('file_a.jsonl') 
_b_data = ChatData.load_jsonl('file_b.jsonl')
assert len(_a_data.funcs) == 13
assert len(_b_data.funcs) == 13
assert _a_data.consistent and _b_data.consistent
assert len(_a_data.to_md()) == 2284

Loaded 2284 rows from file_a.jsonl
Loaded 2284 rows from file_b.jsonl