36 harness runs for **so_extraction**. Overall field match is **-100.0%** with **0.0%** run success.
Each card is one dataset bucket: height is field match, width of the bar is the same. Use this view to see whether the story is uniform or split.
Bubble chart: horizontal axis is average latency (log scale), vertical axis is field match. Upper-left is ideal; bubble size encodes mismatch pressure.
Sort any column, filter few-shot count, and type in the search box. Green and red rows highlight top and bottom quartiles of field match in the current filter.
| Model | FS | Runs | Avg s | Mismatch | Field match |
|---|
Cells aggregate every agent row in the run for each few-shot count (weighted by runs). Flat rows suggest few-shot is not the lever to pull.
Practical follow-ups in priority order:
{
"agent": "so_extraction",
"pipeline": null,
"models": [
"sonnet-4-6",
"opus-4-5",
"opus-4-6",
"sonnet-4-5"
],
"datasets": [
"downloaded"
],
"chat": null,
"chats_glob": null,
"bulk": false,
"runs_per_chat": 1,
"max_workers": 25,
"few_shot_explicit": [
"/Users/tripathipranav/Documents/code/harness_agents/raw_data/chats/multiple_product_multiple_shipment_complex.json",
"/Users/tripathipranav/Documents/code/harness_agents/raw_data/chats/single_product_multiple_shipment_medium.json",
"/Users/tripathipranav/Documents/code/harness_agents/raw_data/chats/single_product_single_shipment_simple.json"
],
"few_shot_walk": [],
"few_shot_sweep": [],
"few_shot_pool_argv": [],
"few_shot_seed": 42,
"db_few_shot_limit": 0,
"skip_without_expected": false,
"results_dir": "/Users/tripathipranav/Documents/code/harness_agents/results/20260515T032806Z",
"config_file": "configs/agents.json",
"few_shot_mode": "explicit",
"few_shot_pool_size": 68,
"few_shot_default_pool_size": 68,
"few_shot_pool_override": null,
"few_shot_variants": [
{
"label": "explicit",
"count": 3,
"paths": [
"raw_data/chats/multiple_product_multiple_shipment_complex.json",
"raw_data/chats/single_product_multiple_shipment_medium.json",
"raw_data/chats/single_product_single_shipment_simple.json"
]
}
],
"allow_self_fewshot": false
}SUCCESS RATE — Share of runs that finished without a harness or HTTP error. High success means the run was stable; it does not prove the answers matched the reference.
AVG ELAPSED (S) — Average wall time per run in that bucket. Useful for latency comparisons.
AVG MISMATCH / EXPECTED RUN — Average count of fields that differed from the golden JSON when a reference existed. Lower is better.
FIELD MATCH — Fraction of compared fields that matched the golden output across runs in that bucket. Higher is better.
| Agent | Chat | Model | FS | Mismatches | Sample |
|---|---|---|---|---|---|
| so_extraction | 01__2026-02-24__120363421131250401_g_us__e05574ec-b110-4554-9fc3-3abb4f9011a8.json | opus-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 1800.0,
"quantity_unit": "kg",
"unit_price": 3250.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "Unknown",
"loading": "Unknown",
"total": 5850.0
}
],
"do_date": "2026-03-31",
"po_date": "2026-02-24",
"po_ref_no": "GIIOFINE - P - S-2026-6",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Advanced payment",
"delivery_terms": "EXW",
"billing_address": "Epic Chemicals Sdn Bhd, 17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia",
"shipping_method": "Collection Against OPO 260012/EC",
"shipping_address": "17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia"
}
]
},
"actual": null
}
] |
| so_extraction | 01__2026-02-24__120363421131250401_g_us__e05574ec-b110-4554-9fc3-3abb4f9011a8.json | opus-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 1800.0,
"quantity_unit": "kg",
"unit_price": 3250.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "Unknown",
"loading": "Unknown",
"total": 5850.0
}
],
"do_date": "2026-03-31",
"po_date": "2026-02-24",
"po_ref_no": "GIIOFINE - P - S-2026-6",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Advanced payment",
"delivery_terms": "EXW",
"billing_address": "Epic Chemicals Sdn Bhd, 17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia",
"shipping_method": "Collection Against OPO 260012/EC",
"shipping_address": "17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia"
}
]
},
"actual": null
}
] |
| so_extraction | 01__2026-02-24__120363421131250401_g_us__e05574ec-b110-4554-9fc3-3abb4f9011a8.json | sonnet-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 1800.0,
"quantity_unit": "kg",
"unit_price": 3250.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "Unknown",
"loading": "Unknown",
"total": 5850.0
}
],
"do_date": "2026-03-31",
"po_date": "2026-02-24",
"po_ref_no": "GIIOFINE - P - S-2026-6",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Advanced payment",
"delivery_terms": "EXW",
"billing_address": "Epic Chemicals Sdn Bhd, 17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia",
"shipping_method": "Collection Against OPO 260012/EC",
"shipping_address": "17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia"
}
]
},
"actual": null
}
] |
| so_extraction | 01__2026-02-24__120363421131250401_g_us__e05574ec-b110-4554-9fc3-3abb4f9011a8.json | sonnet-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 1800.0,
"quantity_unit": "kg",
"unit_price": 3250.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "Unknown",
"loading": "Unknown",
"total": 5850.0
}
],
"do_date": "2026-03-31",
"po_date": "2026-02-24",
"po_ref_no": "GIIOFINE - P - S-2026-6",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Advanced payment",
"delivery_terms": "EXW",
"billing_address": "Epic Chemicals Sdn Bhd, 17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia",
"shipping_method": "Collection Against OPO 260012/EC",
"shipping_address": "17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia"
}
]
},
"actual": null
}
] |
| so_extraction | 02__2026-02-09__120363426578757754_g_us__12a4f3a7-d506-4d32-ae06-3f76508c6abd.json | opus-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 39000.0,
"quantity_unit": "kg",
"unit_price": 2850.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF Nhava Sheva",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25 kgs in PP bags",
"loading": "",
"total": 111150.0
}
],
"do_date": "2026-02-29",
"po_date": "2026-02-09",
"po_ref_no": "GIIOFINE - P - S-2026-5",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Net 30D",
"delivery_terms": "CIF Nhava Sheva",
"billing_address": "GIIAVA India Pvt Ltd, 70/21A Law College Road Pune 411004 India",
"shipping_method": "",
"shipping_address": "C3 MIDC Wai Dist Satara 412803 India"
}
]
},
"actual": null
}
] |
| so_extraction | 02__2026-02-09__120363426578757754_g_us__12a4f3a7-d506-4d32-ae06-3f76508c6abd.json | sonnet-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 39000.0,
"quantity_unit": "kg",
"unit_price": 2850.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF Nhava Sheva",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25 kgs in PP bags",
"loading": "",
"total": 111150.0
}
],
"do_date": "2026-02-29",
"po_date": "2026-02-09",
"po_ref_no": "GIIOFINE - P - S-2026-5",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Net 30D",
"delivery_terms": "CIF Nhava Sheva",
"billing_address": "GIIAVA India Pvt Ltd, 70/21A Law College Road Pune 411004 India",
"shipping_method": "",
"shipping_address": "C3 MIDC Wai Dist Satara 412803 India"
}
]
},
"actual": null
}
] |
| so_extraction | 02__2026-02-09__120363426578757754_g_us__12a4f3a7-d506-4d32-ae06-3f76508c6abd.json | opus-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 39000.0,
"quantity_unit": "kg",
"unit_price": 2850.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF Nhava Sheva",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25 kgs in PP bags",
"loading": "",
"total": 111150.0
}
],
"do_date": "2026-02-29",
"po_date": "2026-02-09",
"po_ref_no": "GIIOFINE - P - S-2026-5",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Net 30D",
"delivery_terms": "CIF Nhava Sheva",
"billing_address": "GIIAVA India Pvt Ltd, 70/21A Law College Road Pune 411004 India",
"shipping_method": "",
"shipping_address": "C3 MIDC Wai Dist Satara 412803 India"
}
]
},
"actual": null
}
] |
| so_extraction | 02__2026-02-09__120363426578757754_g_us__12a4f3a7-d506-4d32-ae06-3f76508c6abd.json | sonnet-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 39000.0,
"quantity_unit": "kg",
"unit_price": 2850.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF Nhava Sheva",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25 kgs in PP bags",
"loading": "",
"total": 111150.0
}
],
"do_date": "2026-02-29",
"po_date": "2026-02-09",
"po_ref_no": "GIIOFINE - P - S-2026-5",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Net 30D",
"delivery_terms": "CIF Nhava Sheva",
"billing_address": "GIIAVA India Pvt Ltd, 70/21A Law College Road Pune 411004 India",
"shipping_method": "",
"shipping_address": "C3 MIDC Wai Dist Satara 412803 India"
}
]
},
"actual": null
}
] |
| so_extraction | 03__2026-01-30__120363403074656566_g_us__8f477a8f-2a60-4e0a-bf0e-8cc3cdf1dc9f.json | opus-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "BergaPur",
"quantity": 6300.0,
"quantity_unit": "kg",
"unit_price": 3050.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg bags in carton",
"loading": "10.5MT / 20'",
"total": 19215.0
}
],
"do_date": "2026-03-31",
"po_date": "2026-01-30",
"po_ref_no": "BergaPur-2026-6",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "7D",
"delivery_terms": "EXW",
"billing_address": "Berg + Schmidt Asia Pte Ltd, 1 North Buona Vista Link #10-06 Elementum Singapore 139691",
"shipping_method": "collection",
"shipping_address": "Unknown"
}
]
},
"actual": null
}
] |
| so_extraction | 03__2026-01-30__120363403074656566_g_us__8f477a8f-2a60-4e0a-bf0e-8cc3cdf1dc9f.json | sonnet-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "BergaPur",
"quantity": 6300.0,
"quantity_unit": "kg",
"unit_price": 3050.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg bags in carton",
"loading": "10.5MT / 20'",
"total": 19215.0
}
],
"do_date": "2026-03-31",
"po_date": "2026-01-30",
"po_ref_no": "BergaPur-2026-6",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "7D",
"delivery_terms": "EXW",
"billing_address": "Berg + Schmidt Asia Pte Ltd, 1 North Buona Vista Link #10-06 Elementum Singapore 139691",
"shipping_method": "collection",
"shipping_address": "Unknown"
}
]
},
"actual": null
}
] |
| so_extraction | 03__2026-01-30__120363403074656566_g_us__8f477a8f-2a60-4e0a-bf0e-8cc3cdf1dc9f.json | sonnet-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "BergaPur",
"quantity": 6300.0,
"quantity_unit": "kg",
"unit_price": 3050.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg bags in carton",
"loading": "10.5MT / 20'",
"total": 19215.0
}
],
"do_date": "2026-03-31",
"po_date": "2026-01-30",
"po_ref_no": "BergaPur-2026-6",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "7D",
"delivery_terms": "EXW",
"billing_address": "Berg + Schmidt Asia Pte Ltd, 1 North Buona Vista Link #10-06 Elementum Singapore 139691",
"shipping_method": "collection",
"shipping_address": "Unknown"
}
]
},
"actual": null
}
] |
| so_extraction | 03__2026-01-30__120363403074656566_g_us__8f477a8f-2a60-4e0a-bf0e-8cc3cdf1dc9f.json | opus-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "BergaPur",
"quantity": 6300.0,
"quantity_unit": "kg",
"unit_price": 3050.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg bags in carton",
"loading": "10.5MT / 20'",
"total": 19215.0
}
],
"do_date": "2026-03-31",
"po_date": "2026-01-30",
"po_ref_no": "BergaPur-2026-6",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "7D",
"delivery_terms": "EXW",
"billing_address": "Berg + Schmidt Asia Pte Ltd, 1 North Buona Vista Link #10-06 Elementum Singapore 139691",
"shipping_method": "collection",
"shipping_address": "Unknown"
}
]
},
"actual": null
}
] |
| so_extraction | 04__2026-01-29__120363408498669191_g_us__4b9c2faa-94dd-4236-abcc-398807051f21.json | sonnet-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 9000.0,
"quantity_unit": "KG",
"unit_price": 3.25,
"pricing_unit": "USD/KG",
"ship_term": "CIF Jakarta",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg bags in carton",
"loading": "25kg bags in carton",
"total": 29250.0
}
],
"do_date": "2026-02-28",
"po_date": "2026-01-29",
"po_ref_no": "GIIOFINE - P - S-2026-4",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "CAD",
"delivery_terms": "CIF Jakarta",
"billing_address": "PT Bright International, Plaza Niaga 1 Blok B No 50 Sentul City - Bogor Indonesia",
"shipping_method": "against PO-IMP-BIB-2601-017",
"shipping_address": "Plaza Niaga 1 Blok B No 50 Sentul City - Bogor Indonesia"
}
]
},
"actual": null
}
] |
| so_extraction | 04__2026-01-29__120363408498669191_g_us__4b9c2faa-94dd-4236-abcc-398807051f21.json | sonnet-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 9000.0,
"quantity_unit": "KG",
"unit_price": 3.25,
"pricing_unit": "USD/KG",
"ship_term": "CIF Jakarta",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg bags in carton",
"loading": "25kg bags in carton",
"total": 29250.0
}
],
"do_date": "2026-02-28",
"po_date": "2026-01-29",
"po_ref_no": "GIIOFINE - P - S-2026-4",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "CAD",
"delivery_terms": "CIF Jakarta",
"billing_address": "PT Bright International, Plaza Niaga 1 Blok B No 50 Sentul City - Bogor Indonesia",
"shipping_method": "against PO-IMP-BIB-2601-017",
"shipping_address": "Plaza Niaga 1 Blok B No 50 Sentul City - Bogor Indonesia"
}
]
},
"actual": null
}
] |
| so_extraction | 04__2026-01-29__120363408498669191_g_us__4b9c2faa-94dd-4236-abcc-398807051f21.json | opus-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 9000.0,
"quantity_unit": "KG",
"unit_price": 3.25,
"pricing_unit": "USD/KG",
"ship_term": "CIF Jakarta",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg bags in carton",
"loading": "25kg bags in carton",
"total": 29250.0
}
],
"do_date": "2026-02-28",
"po_date": "2026-01-29",
"po_ref_no": "GIIOFINE - P - S-2026-4",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "CAD",
"delivery_terms": "CIF Jakarta",
"billing_address": "PT Bright International, Plaza Niaga 1 Blok B No 50 Sentul City - Bogor Indonesia",
"shipping_method": "against PO-IMP-BIB-2601-017",
"shipping_address": "Plaza Niaga 1 Blok B No 50 Sentul City - Bogor Indonesia"
}
]
},
"actual": null
}
] |
| so_extraction | 04__2026-01-29__120363408498669191_g_us__4b9c2faa-94dd-4236-abcc-398807051f21.json | opus-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 9000.0,
"quantity_unit": "KG",
"unit_price": 3.25,
"pricing_unit": "USD/KG",
"ship_term": "CIF Jakarta",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg bags in carton",
"loading": "25kg bags in carton",
"total": 29250.0
}
],
"do_date": "2026-02-28",
"po_date": "2026-01-29",
"po_ref_no": "GIIOFINE - P - S-2026-4",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "CAD",
"delivery_terms": "CIF Jakarta",
"billing_address": "PT Bright International, Plaza Niaga 1 Blok B No 50 Sentul City - Bogor Indonesia",
"shipping_method": "against PO-IMP-BIB-2601-017",
"shipping_address": "Plaza Niaga 1 Blok B No 50 Sentul City - Bogor Indonesia"
}
]
},
"actual": null
}
] |
| so_extraction | 05__2026-01-20__120363407382355715_g_us__12a4f3a7-d506-4d32-ae06-3f76508c6abd.json | opus-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 26000.0,
"quantity_unit": "KG",
"unit_price": 2850.0,
"pricing_unit": "USD/MT",
"ship_term": "CIF NHAVA SHEVA",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "",
"loading": "",
"total": 74100.0
}
],
"do_date": "2026-01-31",
"po_date": "2026-01-20",
"po_ref_no": "GIIOFINE - P - S-2026-3",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Net 30D",
"delivery_terms": "CIF NHAVA SHEVA",
"billing_address": "GIIAVA India Pvt Ltd, 70/21A Law College Road Pune 411004 India",
"shipping_method": "",
"shipping_address": "C3 MIDC Wai Dist Satara 412803 India"
}
]
},
"actual": null
}
] |
| so_extraction | 05__2026-01-20__120363407382355715_g_us__12a4f3a7-d506-4d32-ae06-3f76508c6abd.json | sonnet-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 26000.0,
"quantity_unit": "KG",
"unit_price": 2850.0,
"pricing_unit": "USD/MT",
"ship_term": "CIF NHAVA SHEVA",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "",
"loading": "",
"total": 74100.0
}
],
"do_date": "2026-01-31",
"po_date": "2026-01-20",
"po_ref_no": "GIIOFINE - P - S-2026-3",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Net 30D",
"delivery_terms": "CIF NHAVA SHEVA",
"billing_address": "GIIAVA India Pvt Ltd, 70/21A Law College Road Pune 411004 India",
"shipping_method": "",
"shipping_address": "C3 MIDC Wai Dist Satara 412803 India"
}
]
},
"actual": null
}
] |
| so_extraction | 05__2026-01-20__120363407382355715_g_us__12a4f3a7-d506-4d32-ae06-3f76508c6abd.json | sonnet-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 26000.0,
"quantity_unit": "KG",
"unit_price": 2850.0,
"pricing_unit": "USD/MT",
"ship_term": "CIF NHAVA SHEVA",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "",
"loading": "",
"total": 74100.0
}
],
"do_date": "2026-01-31",
"po_date": "2026-01-20",
"po_ref_no": "GIIOFINE - P - S-2026-3",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Net 30D",
"delivery_terms": "CIF NHAVA SHEVA",
"billing_address": "GIIAVA India Pvt Ltd, 70/21A Law College Road Pune 411004 India",
"shipping_method": "",
"shipping_address": "C3 MIDC Wai Dist Satara 412803 India"
}
]
},
"actual": null
}
] |
| so_extraction | 05__2026-01-20__120363407382355715_g_us__12a4f3a7-d506-4d32-ae06-3f76508c6abd.json | opus-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 26000.0,
"quantity_unit": "KG",
"unit_price": 2850.0,
"pricing_unit": "USD/MT",
"ship_term": "CIF NHAVA SHEVA",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "",
"loading": "",
"total": 74100.0
}
],
"do_date": "2026-01-31",
"po_date": "2026-01-20",
"po_ref_no": "GIIOFINE - P - S-2026-3",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Net 30D",
"delivery_terms": "CIF NHAVA SHEVA",
"billing_address": "GIIAVA India Pvt Ltd, 70/21A Law College Road Pune 411004 India",
"shipping_method": "",
"shipping_address": "C3 MIDC Wai Dist Satara 412803 India"
}
]
},
"actual": null
}
] |
| so_extraction | 06__2026-01-06__120363421131250401_g_us__e05574ec-b110-4554-9fc3-3abb4f9011a8.json | sonnet-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 1800.0,
"quantity_unit": "kg",
"unit_price": 3500.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "",
"loading": "LCL",
"total": 6300.0
}
],
"do_date": "2026-02-28",
"po_date": "2026-01-06",
"po_ref_no": "GIIOFINE - P - S-2026-2",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Advanced payment",
"delivery_terms": "EXW",
"billing_address": "Epic Chemicals Sdn Bhd, 17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia",
"shipping_method": "",
"shipping_address": "17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia"
}
]
},
"actual": null
}
] |
| so_extraction | 06__2026-01-06__120363421131250401_g_us__e05574ec-b110-4554-9fc3-3abb4f9011a8.json | sonnet-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 1800.0,
"quantity_unit": "kg",
"unit_price": 3500.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "",
"loading": "LCL",
"total": 6300.0
}
],
"do_date": "2026-02-28",
"po_date": "2026-01-06",
"po_ref_no": "GIIOFINE - P - S-2026-2",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Advanced payment",
"delivery_terms": "EXW",
"billing_address": "Epic Chemicals Sdn Bhd, 17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia",
"shipping_method": "",
"shipping_address": "17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia"
}
]
},
"actual": null
}
] |
| so_extraction | 06__2026-01-06__120363421131250401_g_us__e05574ec-b110-4554-9fc3-3abb4f9011a8.json | opus-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 1800.0,
"quantity_unit": "kg",
"unit_price": 3500.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "",
"loading": "LCL",
"total": 6300.0
}
],
"do_date": "2026-02-28",
"po_date": "2026-01-06",
"po_ref_no": "GIIOFINE - P - S-2026-2",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Advanced payment",
"delivery_terms": "EXW",
"billing_address": "Epic Chemicals Sdn Bhd, 17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia",
"shipping_method": "",
"shipping_address": "17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia"
}
]
},
"actual": null
}
] |
| so_extraction | 06__2026-01-06__120363421131250401_g_us__e05574ec-b110-4554-9fc3-3abb4f9011a8.json | opus-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "GIIOFINE - P - S",
"quantity": 1800.0,
"quantity_unit": "kg",
"unit_price": 3500.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "",
"loading": "LCL",
"total": 6300.0
}
],
"do_date": "2026-02-28",
"po_date": "2026-01-06",
"po_ref_no": "GIIOFINE - P - S-2026-2",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "Advanced payment",
"delivery_terms": "EXW",
"billing_address": "Epic Chemicals Sdn Bhd, 17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia",
"shipping_method": "",
"shipping_address": "17 Jalan Industri Mas 12,Taman Mas Sepang,47130 Puchong,Selangor,Malaysia"
}
]
},
"actual": null
}
] |
| so_extraction | 07__2025-12-23__120363403074656566_g_us__8f477a8f-2a60-4e0a-bf0e-8cc3cdf1dc9f.json | sonnet-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "BergaPur",
"quantity": 10500.0,
"quantity_unit": "kg",
"unit_price": 3100.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "standard packaging",
"loading": "10.5MT / 20'",
"total": 32550.0
}
],
"do_date": "2026-01-31",
"po_date": "2025-12-23",
"po_ref_no": "BergaPur-2025-4",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "7D",
"delivery_terms": "EXW",
"billing_address": "Berg + Schmidt Asia Pte Ltd, 1 North Buona Vista Link #10-06 Elementum Singapore 139691",
"shipping_method": "",
"shipping_address": "NA"
}
]
},
"actual": null
}
] |
| so_extraction | 07__2025-12-23__120363403074656566_g_us__8f477a8f-2a60-4e0a-bf0e-8cc3cdf1dc9f.json | opus-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "BergaPur",
"quantity": 10500.0,
"quantity_unit": "kg",
"unit_price": 3100.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "standard packaging",
"loading": "10.5MT / 20'",
"total": 32550.0
}
],
"do_date": "2026-01-31",
"po_date": "2025-12-23",
"po_ref_no": "BergaPur-2025-4",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "7D",
"delivery_terms": "EXW",
"billing_address": "Berg + Schmidt Asia Pte Ltd, 1 North Buona Vista Link #10-06 Elementum Singapore 139691",
"shipping_method": "",
"shipping_address": "NA"
}
]
},
"actual": null
}
] |
| so_extraction | 07__2025-12-23__120363403074656566_g_us__8f477a8f-2a60-4e0a-bf0e-8cc3cdf1dc9f.json | sonnet-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "BergaPur",
"quantity": 10500.0,
"quantity_unit": "kg",
"unit_price": 3100.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "standard packaging",
"loading": "10.5MT / 20'",
"total": 32550.0
}
],
"do_date": "2026-01-31",
"po_date": "2025-12-23",
"po_ref_no": "BergaPur-2025-4",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "7D",
"delivery_terms": "EXW",
"billing_address": "Berg + Schmidt Asia Pte Ltd, 1 North Buona Vista Link #10-06 Elementum Singapore 139691",
"shipping_method": "",
"shipping_address": "NA"
}
]
},
"actual": null
}
] |
| so_extraction | 07__2025-12-23__120363403074656566_g_us__8f477a8f-2a60-4e0a-bf0e-8cc3cdf1dc9f.json | opus-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "BergaPur",
"quantity": 10500.0,
"quantity_unit": "kg",
"unit_price": 3100.0,
"pricing_unit": "usd/mt",
"ship_term": "EXW",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "standard packaging",
"loading": "10.5MT / 20'",
"total": 32550.0
}
],
"do_date": "2026-01-31",
"po_date": "2025-12-23",
"po_ref_no": "BergaPur-2025-4",
"vendor_name": "GIIAVA Singapore Pte Ltd",
"payment_date": "7D",
"delivery_terms": "EXW",
"billing_address": "Berg + Schmidt Asia Pte Ltd, 1 North Buona Vista Link #10-06 Elementum Singapore 139691",
"shipping_method": "",
"shipping_address": "NA"
}
]
},
"actual": null
}
] |
| so_extraction | 08__2025-09-29__120363403592950429_g_us__d586d853-694c-42f9-93be-bc7ba5b2110c.json | sonnet-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "TG - BP102",
"quantity": 46000.0,
"quantity_unit": "kg",
"unit_price": 1410.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg printed paper bags",
"loading": "23 MT / 40' FCL",
"total": 64860.0
}
],
"do_date": "2025-11-15",
"po_date": "2025-09-29",
"po_ref_no": "TG - BP102-2025-3",
"vendor_name": "AG Lipids Pte Ltd",
"payment_date": "Net 14 Days",
"delivery_terms": "CIF",
"billing_address": "FeedBEST Company Limited, Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea",
"shipping_method": "Unknown",
"shipping_address": "Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea"
}
]
},
"actual": null
}
] |
| so_extraction | 08__2025-09-29__120363403592950429_g_us__d586d853-694c-42f9-93be-bc7ba5b2110c.json | opus-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "TG - BP102",
"quantity": 46000.0,
"quantity_unit": "kg",
"unit_price": 1410.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg printed paper bags",
"loading": "23 MT / 40' FCL",
"total": 64860.0
}
],
"do_date": "2025-11-15",
"po_date": "2025-09-29",
"po_ref_no": "TG - BP102-2025-3",
"vendor_name": "AG Lipids Pte Ltd",
"payment_date": "Net 14 Days",
"delivery_terms": "CIF",
"billing_address": "FeedBEST Company Limited, Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea",
"shipping_method": "Unknown",
"shipping_address": "Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea"
}
]
},
"actual": null
}
] |
| so_extraction | 08__2025-09-29__120363403592950429_g_us__d586d853-694c-42f9-93be-bc7ba5b2110c.json | opus-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "TG - BP102",
"quantity": 46000.0,
"quantity_unit": "kg",
"unit_price": 1410.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg printed paper bags",
"loading": "23 MT / 40' FCL",
"total": 64860.0
}
],
"do_date": "2025-11-15",
"po_date": "2025-09-29",
"po_ref_no": "TG - BP102-2025-3",
"vendor_name": "AG Lipids Pte Ltd",
"payment_date": "Net 14 Days",
"delivery_terms": "CIF",
"billing_address": "FeedBEST Company Limited, Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea",
"shipping_method": "Unknown",
"shipping_address": "Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea"
}
]
},
"actual": null
}
] |
| so_extraction | 08__2025-09-29__120363403592950429_g_us__d586d853-694c-42f9-93be-bc7ba5b2110c.json | sonnet-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "TG - BP102",
"quantity": 46000.0,
"quantity_unit": "kg",
"unit_price": 1410.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg printed paper bags",
"loading": "23 MT / 40' FCL",
"total": 64860.0
}
],
"do_date": "2025-11-15",
"po_date": "2025-09-29",
"po_ref_no": "TG - BP102-2025-3",
"vendor_name": "AG Lipids Pte Ltd",
"payment_date": "Net 14 Days",
"delivery_terms": "CIF",
"billing_address": "FeedBEST Company Limited, Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea",
"shipping_method": "Unknown",
"shipping_address": "Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea"
}
]
},
"actual": null
}
] |
| so_extraction | 09__2025-09-29__120363403592950429_g_us__d586d853-694c-42f9-93be-bc7ba5b2110c.json | sonnet-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "TG - BP102",
"quantity": 23000.0,
"quantity_unit": "kg",
"unit_price": 1410.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg printed paper bag",
"loading": "23 MT / 40' FCL",
"total": 32430.0
}
],
"do_date": "2025-11-15",
"po_date": "2025-09-29",
"po_ref_no": "TG - BP102-2025-1",
"vendor_name": "AG Lipids Pte Ltd",
"payment_date": "Net 14 Days",
"delivery_terms": "CIF",
"billing_address": "FeedBEST Company Limited, Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea",
"shipping_method": "Unknown",
"shipping_address": "Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea"
}
]
},
"actual": null
}
] |
| so_extraction | 09__2025-09-29__120363403592950429_g_us__d586d853-694c-42f9-93be-bc7ba5b2110c.json | opus-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "TG - BP102",
"quantity": 23000.0,
"quantity_unit": "kg",
"unit_price": 1410.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg printed paper bag",
"loading": "23 MT / 40' FCL",
"total": 32430.0
}
],
"do_date": "2025-11-15",
"po_date": "2025-09-29",
"po_ref_no": "TG - BP102-2025-1",
"vendor_name": "AG Lipids Pte Ltd",
"payment_date": "Net 14 Days",
"delivery_terms": "CIF",
"billing_address": "FeedBEST Company Limited, Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea",
"shipping_method": "Unknown",
"shipping_address": "Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea"
}
]
},
"actual": null
}
] |
| so_extraction | 09__2025-09-29__120363403592950429_g_us__d586d853-694c-42f9-93be-bc7ba5b2110c.json | opus-4-6 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "TG - BP102",
"quantity": 23000.0,
"quantity_unit": "kg",
"unit_price": 1410.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg printed paper bag",
"loading": "23 MT / 40' FCL",
"total": 32430.0
}
],
"do_date": "2025-11-15",
"po_date": "2025-09-29",
"po_ref_no": "TG - BP102-2025-1",
"vendor_name": "AG Lipids Pte Ltd",
"payment_date": "Net 14 Days",
"delivery_terms": "CIF",
"billing_address": "FeedBEST Company Limited, Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea",
"shipping_method": "Unknown",
"shipping_address": "Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea"
}
]
},
"actual": null
}
] |
| so_extraction | 09__2025-09-29__120363403592950429_g_us__d586d853-694c-42f9-93be-bc7ba5b2110c.json | sonnet-4-5 | 3 | 2 | [
{
"path": "",
"expected": {
"data": [
{
"items": [
{
"sr_no": 1,
"description": "TG - BP102",
"quantity": 23000.0,
"quantity_unit": "kg",
"unit_price": 1410.0,
"pricing_unit": "usd/mt",
"ship_term": "CIF",
"delivery_terms": "",
"shipment_date": "",
"shipping_address": "",
"packing": "25kg printed paper bag",
"loading": "23 MT / 40' FCL",
"total": 32430.0
}
],
"do_date": "2025-11-15",
"po_date": "2025-09-29",
"po_ref_no": "TG - BP102-2025-1",
"vendor_name": "AG Lipids Pte Ltd",
"payment_date": "Net 14 Days",
"delivery_terms": "CIF",
"billing_address": "FeedBEST Company Limited, Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea",
"shipping_method": "Unknown",
"shipping_address": "Factory 354-58 Mojeon-1 Sobuk-gu Republic of Korea"
}
]
},
"actual": null
}
] |