Reproducibility Package for LLPSv2: Unified Evaluation of LLM-Generated Code
Abstract
This record provides the reproducibility resources for the paper "LLPSv2: A Unified Metric for Evaluating Code Generated by Large Language Models". The reproducibility webpage includes:• Prompt templates used for all LLMs• Raw LLM-generated issues• Preprocessing pipeline
Full text
Systematic Selection of LeetCode Problems by Difficulty Level Problem ID Link Difficulty Level 52 Link Hard 66 Link Easy 111 Link Easy 127 Link Hard 157 Link Easy 212 Link Hard 228 Link Easy 263 Link Easy 301 Link Hard 326 Link Easy 335 Link Hard 367 Link Easy 383 Link Hard 405 Link Easy 425 Link Hard 459 Link Easy 471 Link Hard 500 Link Easy 502 Link Hard 530 Link Easy 546 Link Hard 572 Link Easy 12/14/25, 6:30 PM Sheet1 - From Excel https://umarejayesh.github.io/LLPSv2/Reproducible.html 1/7
Problem ID Link Difficulty Level 588 Link Hard 605 Link Easy 632 Link Hard 674 Link Easy 675 Link Hard 719 Link Hard 728 Link Easy 757 Link Hard 771 Link Easy 805 Link Hard 824 Link Easy 847 Link Hard 872 Link Easy 878 Link Hard 896 Link Easy 906 Link Hard 938 Link Easy 940 Link Hard 972 Link Hard 993 Link Easy 1001 Link Hard 1022 Link Easy 1032 Link Hard 1047 Link Easy 1067 Link Hard 12/14/25, 6:30 PM Sheet1 - From Excel https://umarejayesh.github.io/LLPSv2/Reproducible.html 2/7
Problem ID Link Difficulty Level 1085 Link Easy 1106 Link Hard 1119 Link Easy 1145 Link Medium 1153 Link Hard 1160 Link Easy 1170 Link Medium 1187 Link Hard 1189 Link Easy 1198 Link Medium 1224 Link Hard 1227 Link Medium 1228 Link Easy 1257 Link Medium 1260 Link Easy 1269 Link Hard 1283 Link Medium 1287 Link Easy 1307 Link Hard 1309 Link Easy 1311 Link Medium 1337 Link Easy 1339 Link Medium 1340 Link Hard 1365 Link Easy 12/14/25, 6:30 PM Sheet1 - From Excel https://umarejayesh.github.io/LLPSv2/Reproducible.html 3/7
Problem ID Link Difficulty Level 1367 Link Medium 1373 Link Hard 1391 Link Medium 1399 Link Easy 1416 Link Hard 1419 Link Medium 1426 Link Easy 1443 Link Medium 1450 Link Easy 1458 Link Hard 1472 Link Medium 1486 Link Easy 1493 Link Medium 1494 Link Hard 1523 Link Easy 1525 Link Medium 1531 Link Hard 1550 Link Easy 1552 Link Medium 1563 Link Hard 1578 Link Medium 1582 Link Easy 1601 Link Hard 1603 Link Easy 1605 Link Medium 12/14/25, 6:30 PM Sheet1 - From Excel https://umarejayesh.github.io/LLPSv2/Reproducible.html 4/7
Problem ID Link Difficulty Level 1629 Link Easy 1631 Link Medium 1639 Link Hard 1652 Link Easy 1657 Link Medium 1681 Link Hard 1682 Link Medium 1688 Link Easy 1706 Link Medium 1714 Link Hard 1720 Link Easy 1734 Link Medium 1751 Link Hard 1752 Link Easy 1759 Link Medium 1784 Link Easy 1786 Link Medium 1793 Link Hard 1814 Link Medium 1826 Link Easy 1830 Link Hard 1839 Link Medium 1859 Link Easy 1865 Link Medium 1866 Link Hard 12/14/25, 6:30 PM Sheet1 - From Excel https://umarejayesh.github.io/LLPSv2/Reproducible.html 5/7
Problem ID Link Difficulty Level 1894 Link Medium 1897 Link Easy 1903 Link Easy 1903 Link Hard 1922 Link Medium 1938 Link Hard 1947 Link Medium 1971 Link Easy 1971 Link Hard 1976 Link Medium 2002 Link Medium 2009 Link Hard 2029 Link Medium 2040 Link Hard 2055 Link Medium 2080 Link Medium 2109 Link Medium 2135 Link Medium 2162 Link Medium 2192 Link Medium 2222 Link Medium 2250 Link Medium 2275 Link Medium 2305 Link Medium 2333 Link Medium 12/14/25, 6:30 PM Sheet1 - From Excel https://umarejayesh.github.io/LLPSv2/Reproducible.html 6/7
Problem ID Link Difficulty Level 2365 Link Medium 2391 Link Medium 2420 Link Medium 2447 Link Medium 2471 Link Medium © Jayesh Umre — Connect with me on LinkedIn 12/14/25, 6:30 PM Sheet1 - From Excel https://umarejayesh.github.io/LLPSv2/Reproducible.html 7/7