Assertive action by China's coast guard in the South China Sea risks destabilizing the region, according to researchers.