Negotiation is a core component of day-to-day life and international politics. But this is not a skill we associate with the everyday Artificial Intelligence of today: Siri and Alexa do not renegotiate the length of a timer or the details of a question. We study how AI game-playing in the board game of Diplomacy can be enhanced through communication. In past work, we collected conversational in-game language data from human players. In current work, we annotate this data to provide game AIs with dialog options. In addition to expanding the communication, we investigate how long-term cooperation and relationships can be rewarded in strategic game-play. The test-bed of Diplomacy allows us to design communication channels between AIs. In turn, this will help us design communication channels between AIs and humans.