Who does Azad think was speaking to Lovely about his relationship with her in Part I, and why does this upset him?

Azad thinks his brother might have been speaking to Lovely about his relationship with her in Part I, which upsets him because he knows his brother is critical of Lovely.