Sidelaning in the midgame

Hey, so as Jax I'm taught that I should get strong in the laning phase so that I can dual the enemy in the sidelane oposite of the next objective. This works very well most of the time, but I find myself struggling if lets say dragon and rift is up or dragon + atakhan(topside). How do I prioritize and predict where my team will play?