Thread · HN Continuity

I literally just automated some transcription of bank and credit card statements, using `pdftotext` from the homebrew `poppler` package, and Papero is unfortunately vastly inferior to pdftotext for this format (banks in Canada seemingly only allow you to get historic statements as PDFs).

Papero seemingly fails to determine any structure here.. for reference, this is the bash script I used to process credit card statements from Scotiabank. While this doesn't generate structured data (which I could certainly do with more work), it generates text files which preserve the layout, making it greppable, which is good enough for my needs right now.

    for f in *.pdf; do
      f=&quot;${f%.pdf}&quot;
      if [[ -f &quot;${f}&quot;.txt ]]; then
        continue
      fi
      # e.g. &quot;Statement Period Mar 7, 2024 - Apr 4, 2024&quot;
      period=$(pdftotext -f 1 -l 1 -nopgbrk -layout -x 331 -y 9 -W 277 -H 15 &quot;${f}.pdf&quot; - | xargs | sed &#x27;s&#x2F;Statement Period &#x2F;&#x2F;&#x27;)
      startdate=${period%%-*}
      enddate=${period#*-}
      newname=$(gdate -d &quot;${startdate}&quot; +%F)_$(gdate -d &quot;${enddate}&quot; +%F)
      mv &quot;${f}.pdf&quot; ${newname}.pdf
      pdftotext -nopgbrk -f 1 -l 1 -x 70 -W 300 -y 276 -H 600 -layout &quot;${newname}.pdf&quot;
      pdftotext -nopgbrk -f 3 -l 3 -x 70 -W 300 -y 170 -H 720 -layout &quot;${newname}.pdf&quot; - &gt;&gt; ${newname}.txt
    done

Extracting the tabular data here should be pretty straightforward as well, I just haven't needed to do it.

LLMs would absolutely eat this kind of task up (writing a script that can turn it into structured data), but I don't have local LLMs set up and don't really wanna send financial records to big AI.