Yes, Tatsuo does know better. Because even though he's not wild about venturing into these pocket universes, he'd hate it if someone told him to stay out of them. That's his decision to make, just like it's Togusa's decision to make.

"It's only because you're a grown ass adult and I'm not actually your father that I don't."