There really isn't much out there, you may want to read some late XIX or early XX century books like Alice in wonderland or the like, since that's basically the time when they got a great hit.
Nowadays books are almost always trying to copy those… so there's not really much out there. How about reading manga?
No, not today!
house of leaves is definitely more "reality is broken, this isn't right!!!!" horror-themed but it's about as close as I can think of to Yume Nikki related literature.
Overrated commercial shit.
The Dream-Quest of Unknown Kadath by H. P. Lovecraft.
His Dream Cycle too.