Using ConnectToMaster does not join self hosted photon server

I'm using this to connect to the server

PhotonNetwork.GameVersion = "v0.0.1";
PhotonNetwork.ConnectToMaster(IPAddress, 5055, "");

but it disconnects me immediately after trying to join

OnDisconnected was called by PUN with reason DisconnectByServerReasonUnknown
UnityEngine.Debug:LogWarningFormat(String, Object[])
LobbyManager:OnDisconnected(DisconnectCause) (at Assets/Scripts/LobbyManager.cs:108)
Photon.Realtime.ConnectionCallbacksContainer:OnDisconnected(DisconnectCause) (at Assets/Photon/PhotonRealtime/Code/LoadBalancingClient.cs:3428)
Photon.Realtime.LoadBalancingClient:OnStatusChanged(StatusCode) (at Assets/Photon/PhotonRealtime/Code/LoadBalancingClient.cs:2568)
ExitGames.Client.Photon.<>c__DisplayClass103_0:b__0()
ExitGames.Client.Photon.EnetPeer:DispatchIncomingCommands()
ExitGames.Client.Photon.PhotonPeer:DispatchIncomingCommands()
Photon.Pun.PhotonHandler:FixedUpdate() (at Assets/Photon/PhotonUnityNetworking/Code/PhotonHandler.cs:116)

IPAddress is set to the Game Server IP Local address, any help is appreciated!