History

Bad benchmarks and evals: Senior SWE-Bench, napkin math, and winter tires

Open thread

First rank

18

Best rank

12

Last rank

29

Observations

71

First seen

1789365901

Last seen

1789395159

Missing captures

0

Milestones

1

Top is rank 1. Gaps between captures are not reconstructed.

1. Rank 29

   50 points · 34 comments · observed 1789395159

2. Rank 26

   50 points · 33 comments · observed 1789394720

3. Rank 27

   49 points · 33 comments · observed 1789394267

4. Rank 23

   48 points · 32 comments · observed 1789393820

5. Rank 23

   48 points · 31 comments · observed 1789393369

6. Rank 24

   47 points · 29 comments · observed 1789392920

7. Rank 23

   47 points · 27 comments · observed 1789392480

8. Rank 25

   46 points · 25 comments · observed 1789392036

9. Rank 25

   46 points · 24 comments · observed 1789391596

10. Rank 25

    45 points · 22 comments · observed 1789391152

11. Rank 26

    45 points · 22 comments · observed 1789390707

12. Rank 24

    45 points · 19 comments · observed 1789390275

13. Rank 25

    45 points · 18 comments · observed 1789389848

14. Rank 25

    44 points · 18 comments · observed 1789389411

15. Rank 24

    44 points · 17 comments · observed 1789388987

16. Rank 22

    43 points · 16 comments · observed 1789388556

17. Rank 23

    42 points · 16 comments · observed 1789388107

18. Rank 18

    42 points · 15 comments · observed 1789387682

19. Rank 22

    39 points · 15 comments · observed 1789387242

20. Rank 22

    39 points · 14 comments · observed 1789386816

21. Rank 22

    38 points · 14 comments · observed 1789386392

22. Rank 22

    37 points · 14 comments · observed 1789385967

23. Rank 19

    35 points · 13 comments · observed 1789385553

24. Rank 22

    34 points · 13 comments · observed 1789385138

25. Rank 21

    34 points · 13 comments · observed 1789384726

26. Rank 21

    34 points · 12 comments · observed 1789384314

27. Rank 20

    33 points · 12 comments · observed 1789383911

28. Rank 19

    31 points · 12 comments · observed 1789383497

29. Rank 20

    30 points · 12 comments · observed 1789383088

30. Rank 19

    30 points · 11 comments · observed 1789382676

31. Rank 19

    30 points · 10 comments · observed 1789382256

32. Rank 21

    29 points · 10 comments · observed 1789381836

33. Rank 20

    29 points · 10 comments · observed 1789381424

34. Rank 19

    29 points · 9 comments · observed 1789381017

35. Rank 20

    28 points · 8 comments · observed 1789380604

36. Rank 20

    28 points · 7 comments · observed 1789380196

37. Rank 19

    28 points · 7 comments · observed 1789379784

38. Rank 25

    26 points · 6 comments · observed 1789379372

39. Rank 24

    26 points · 6 comments · observed 1789378955

40. Rank 22

    26 points · 6 comments · observed 1789378553

41. Rank 23

    26 points · 5 comments · observed 1789378141

42. Rank 22

    26 points · 5 comments · observed 1789377733

43. Rank 22

    25 points · 4 comments · observed 1789377325

44. Rank 19

    25 points · 4 comments · observed 1789376905

45. Rank 18

    23 points · 3 comments · observed 1789376497

46. Rank 17

    23 points · 3 comments · observed 1789376084

47. Rank 19

    22 points · 3 comments · observed 1789375678

48. Rank 19

    22 points · 3 comments · observed 1789375270

49. Rank 20

    22 points · 3 comments · observed 1789374867

50. Rank 22

    22 points · 2 comments · observed 1789374455

51. Rank 21

    22 points · 2 comments · observed 1789374054

52. Rank 22

    22 points · 2 comments · observed 1789373647

53. Rank 20

    21 points · 2 comments · observed 1789373238

54. Rank 19

    21 points · 2 comments · observed 1789372829

55. Rank 19

    20 points · 2 comments · observed 1789372425

56. Rank 17

    19 points · 2 comments · observed 1789372022

57. Rank 15

    18 points · 2 comments · observed 1789371611

58. Rank 15

    18 points · 2 comments · observed 1789371199

59. Rank 14

    18 points · 2 comments · observed 1789370794

60. Rank 15

    15 points · 2 comments · observed 1789370379

61. Rank 19

    14 points · 2 comments · observed 1789369960

62. Rank 19

    13 points · 2 comments · observed 1789369555

63. Rank 16

    12 points · 2 comments · observed 1789369144

64. Rank 15

    12 points · 2 comments · observed 1789368736

65. Rank 15

    11 points · 2 comments · observed 1789368333

66. Rank 14

    8 points · 1 comments · observed 1789367925

67. Rank 12

    8 points · 1 comments · observed 1789367522

68. Rank 12

    8 points · 1 comments · observed 1789367119

69. Rank 12

    6 points · 1 comments · observed 1789366718

70. Rank 12

    6 points · 0 comments · observed 1789366306

71. Rank 18

    3 points · 0 comments · observed 1789365901

Unofficial Hacker News client; not affiliated with Y Combinator.