You must mean shift-J, not control J.

In vi you can do this:
:g/^M/j

But to type the ^M, you need to type cntl-V followed by cntl-M.