According to IMDB, the part was written with Madsen in mind but Crowe ended up with the part. It is speculated that Madsen wasn't even approached for the role.
Note:
This L.A. Confidential trivia and all movie trivia on notstarring.com is
submitted and reviewed by movie fans from around the world. We strive to
provide reliability in our movie trivia database, and we go to great
lengths to try and corroborate entries. Still, by its nature, this type
of trivia will always be prone to rumor and funny Hollywood gossip and
should be relied upon with appropriate caution. Please help by reporting
corrections for this L.A. Confidential
trivia or other movie trivia.