DeeperGCN: Training Deeper GCNs With Generalized Aggregation Functions.

Graph Neural Networks (GNNs) have been drawing significant attention to representation learning on graphs. Recent works developed frameworks to train very deep GNNs and showed impressive results in tasks like point cloud learning and protein interaction prediction. In this work, we study the performance of such deep models in large-scale graphs. In particular, we look at the effect of adequately choosing an aggregation function on deep models. We find that GNNs are very sensitive to the choice of aggregation functions (e.g. mean, max, and sum) when applied to different datasets. We systematically study and propose to alleviate this issue by introducing a novel class of aggregation functions named Generalized Aggregation Functions. The proposed functions extend beyond commonly used aggregation functions to a wide range of new permutation-invariant functions. Generalized Aggregation Functions are fully differentiable, where their parameters can be learned in an end-to-end fashion to yield a suitable aggregation function for each task. We show that equipped with the proposed aggregation functions, deep residual GNNs outperform state-of-the-art in several benchmarks from Open Graph Benchmark (OGB) across tasks and domains.

Inverse design of plasmonic metasurfaces by convolutional neural network.

Artificial neural networks have shown effectiveness in the inverse design of nanophotonic structures; however, the numerical accuracy and algorithm efficiency are not analyzed adequately in previous reports. In this Letter, we demonstrate the convolutional neural network as an inverse design tool to achieve high numerical accuracy in plasmonic metasurfaces. A comparison of the convolutional neural networks and the fully connected neural networks show that convolutional neural networks have higher generalization capabilities. We share practical guidelines for optimizing the neural network and analyzed the hierarchy of accuracy in the multi-parameter inverse design of plasmonic metasurfaces. A high inverse design accuracy of $\pm 8\;{\rm nm}$±8nm for the critical geometrical parameters is demonstrated.