Transit traffic works fine but traffic destined to the SRX or sourced from the SRX does not work.
We found out there was a firewall filter applied on the loopback interface, which had a term discarding all traffic. This term was misplaced; and this caused all terms below it to be shadowed, resulting in traffic drops.
We inserted this "everything else" filter term at the bottom and the connectivity was restored after this.