The lauded author’s Helsinki Trilogy vanishes the boundaries of form and genre — and it’s finally available to anglophone readers