I thought they were going to have a little kiss and maybe Red would have gave him the confidence to go out and find a real relationship (not a mail-ordered one) but after what happened to her, I'd like to think he still went to visit her.
I personally don't like how much they were normalizing these relationships between cos and prisoners there's reasons for those law the power imbalance makes it gross and exploitative