You could discuss the probability of a joint fence installation with your neighbor. If it does not work, notify your neighbor before starting the installation of the panels. Once you have installed the fence, maintain it. The main reason for the installation may be privacy, but if you do not maintain the fence, it may spoil the beauty of your house.