Timezone: »
Encoding constraints into neural networks is attractive. This paper studies how to introduce the popular positive linear satisfiability to neural networks. We propose the first differentiable satisfiability layer based on an extension of the classic Sinkhorn algorithm for jointly encoding multiple sets of marginal distributions. We further theoretically characterize the convergence property of the Sinkhorn algorithm for multiple marginals, and the underlying formulation is also derived. In contrast to the sequential decision e.g. reinforcement learning-based solvers, we showcase our technique in solving constrained (specifically satisfiability) problems by one-shot neural networks, including i) a neural routing solver learned without supervision of optimal solutions; ii) a partial graph matching network handling graphs with unmatchable outliers on both sides; iii) a predictive network for financial portfolios with continuous constraints. To our knowledge, there exists no one-shot neural solver for these scenarios when they are formulated as satisfiability problems. Source code is available at https://github.com/Thinklab-SJTU/LinSATNet.
Author Information
Runzhong Wang (Shanghai Jiao Tong University)
Yunhao Zhang (Shanghai Jiao Tong University)
Ziao Guo (Shanghai Jiaotong University)
Tianyi Chen (Shanghai Jiaotong University)
Xiaokang Yang (Shanghai Jiao Tong University of China)
Junchi Yan (Shanghai Jiao Tong University)
More from the Same Authors
-
2023 Poster: Towards Quantum Machine Learning for Constrained Combinatorial Optimization: a Quantum QAP Solver »
Xinyu Ye · Ge Yan · Junchi Yan -
2023 Poster: Patch-level Contrastive Learning via Positional Query for Visual Pre-training »
Shaofeng Zhang · Qiang Zhou · Zhibin Wang · Fan Wang · Junchi Yan -
2023 Poster: Quantum 3D Graph Learning with Applications to Molecule Embedding »
Ge Yan · Huaijin Wu · Junchi Yan -
2023 Poster: QAS-Bench: Rethinking Quantum Architecture Search and A Benchmark »
Xudong Lu · Kaisen Pan · Ge Yan · Jiaming Shan · Wenjie Wu · Junchi Yan -
2023 Poster: Understanding and Generalizing Contrastive Learning from the Inverse Optimal Transport Perspective »
Liangliang Shi · Gu Zhang · Haoyu Zhen · Jintao Fan · Junchi Yan -
2023 Poster: QuantumDARTS: Differentiable Quantum Architecture Search for Variational Quantum Algorithms »
Wenjie Wu · Ge Yan · Xudong Lu · Kaisen Pan · Junchi Yan -
2022 Poster: NeuroFluid: Fluid Dynamics Grounding with Particle-Driven Neural Radiance Fields »
Shanyan Guan · Huayu Deng · Yunbo Wang · Xiaokang Yang -
2022 Spotlight: NeuroFluid: Fluid Dynamics Grounding with Particle-Driven Neural Radiance Fields »
Shanyan Guan · Huayu Deng · Yunbo Wang · Xiaokang Yang -
2022 Poster: On Collective Robustness of Bagging Against Data Poisoning »
Ruoxin Chen · Zenan Li · Jie Li · Junchi Yan · Chentao Wu -
2022 Poster: Deep Neural Network Fusion via Graph Matching with Applications to Model Ensemble and Federated Learning »
Chang Liu · Chenfei Lou · Runzhong Wang · Alan Yuhan Xi · Li Shen · Junchi Yan -
2022 Poster: GNNRank: Learning Global Rankings from Pairwise Comparisons via Directed Graph Neural Networks »
Yixuan He · Quan Gan · David Wipf · Gesine Reinert · Junchi Yan · Mihai Cucuringu -
2022 Spotlight: GNNRank: Learning Global Rankings from Pairwise Comparisons via Directed Graph Neural Networks »
Yixuan He · Quan Gan · David Wipf · Gesine Reinert · Junchi Yan · Mihai Cucuringu -
2022 Spotlight: Deep Neural Network Fusion via Graph Matching with Applications to Model Ensemble and Federated Learning »
Chang Liu · Chenfei Lou · Runzhong Wang · Alan Yuhan Xi · Li Shen · Junchi Yan -
2022 Spotlight: On Collective Robustness of Bagging Against Data Poisoning »
Ruoxin Chen · Zenan Li · Jie Li · Junchi Yan · Chentao Wu -
2021 Poster: Towards Open-World Recommendation: An Inductive Model-based Collaborative Filtering Approach »
Qitian Wu · Hengrui Zhang · Xiaofeng Gao · Junchi Yan · Hongyuan Zha -
2021 Poster: Learning Self-Modulating Attention in Continuous Time Space with Applications to Sequential Recommendation »
Chao Chen · Haoyu Geng · Nianzu Yang · Junchi Yan · Daiyue Xue · Jianping Yu · Xiaokang Yang -
2021 Spotlight: Towards Open-World Recommendation: An Inductive Model-based Collaborative Filtering Approach »
Qitian Wu · Hengrui Zhang · Xiaofeng Gao · Junchi Yan · Hongyuan Zha -
2021 Spotlight: Learning Self-Modulating Attention in Continuous Time Space with Applications to Sequential Recommendation »
Chao Chen · Haoyu Geng · Nianzu Yang · Junchi Yan · Daiyue Xue · Jianping Yu · Xiaokang Yang -
2021 Poster: Deep Latent Graph Matching »
Tianshu Yu · Runzhong Wang · Junchi Yan · baoxin Li -
2021 Spotlight: Deep Latent Graph Matching »
Tianshu Yu · Runzhong Wang · Junchi Yan · baoxin Li -
2021 Poster: Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss »
Xue Yang · Junchi Yan · Qi Ming · Wentao Wang · xiaopeng zhang · Qi Tian -
2021 Spotlight: Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss »
Xue Yang · Junchi Yan · Qi Ming · Wentao Wang · xiaopeng zhang · Qi Tian -
2020 Poster: Video Prediction via Example Guidance »
Jingwei Xu · Harry (Huazhe) Xu · Bingbing Ni · Xiaokang Yang · Trevor Darrell