Learning Adaptive Quantum State Tomography with Neural Networks & Differentiable Programming
Stanislav Fort Stanford University (prev. Google Research)
[email protected] stanford.edu/~sfort1/ @stanislavfort
Primarily based on arXiv 1812.06693
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Primarily based on arXiv 1812.06693, in review
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Primarily based on arXiv 1812.06693, in review
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA AI, ML, DL & differentiable programming
● Artificial intelligence: The science of making machines smart ● Machine learning: Machines getting smart from data ● Deep learning: Machines getting smart from data using deep neural networks as functional approximators ● Differentiable programming: Taking partial derivatives through programs, not restricted to deep neural networks as functions
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA AI, ML, DL & differentiable programming
● Artificial intelligence: The science of making machines smart ● Machine learning: Machines getting smart from data ● Deep learning: Machines getting smart from data using deep neural networks as functional approximators ● Differentiable programming: Taking partial derivatives through programs, not restricted to deep neural networks as functions
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA AI, ML, DL & differentiable programming
● Artificial intelligence: The science of making machines smart ● Machine learning: Machines getting smart from data ● Deep learning: Machines getting smart from data using deep neural networks as functional approximators ● Differentiable programming: Taking partial derivatives through programs, not restricted to deep neural networks as functions
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA AI, ML, DL & differentiable programming
● Artificial intelligence: The science of making machines smart ● Machine learning: Machines getting smart from data ● Deep learning: Machines getting smart from data using deep neural networks as functional approximators ● Differentiable programming: Taking partial derivatives through programs, not restricted to deep neural networks as functions
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Differentiable programming Heat equation example ∂ Bridging ML & scientific computing
∂ temperature field
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Differentiable programming Quantum games example ∂
∂ quantum game strategy
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Writing down a solution vs learning a solution Bubble sort (explicit) Image classification (learned) f( )= “tortoise”
Translation (much better when learned)
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Writing down a solution vs learning a solution
Even solving symbolic math
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Machine learning Learning to get faster (& better) heuristics
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Machine learning Learning to get faster (& better) heuristics
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Network & data structure How to induce the correct learning prior?
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first ? ? ? ? ?
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first ? ? ? ? ?
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first ? ? ? ? ?
(Adaptivity)
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first ? ? ? ? ?
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first
?? ?? ? ?? ? ??
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first ? ? ?? ????? ?? ?? ??
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first N ? ? ?? ?? ? ? ?????? ?? ?? ??
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first N ? ??? ???? ? ?????? ?? ? ??
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography Pure states first N ? ??? ???? ? ?????? ?? ? ??
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Quantum state tomography What is difficult? N ? ??? ???? ? ?????? ?? ? ??
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Pure states → density matrices
Pure states Density matrices
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA What do we care about?
1) How precisely can you reconstruct the unknown state, given N copies of the unknown state?
2) How much compute does it take?
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Regular Quantum State Tomography
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Regular Quantum State
Stage 1: Take measurementsTomography
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Regular Quantum State
TomographyStage 2: Process them
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Regular Quantum State Tomography Problem: Measurements expensive
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Adaptive Quantum State Tomography Ferenc Huszár, Neil M. T. Houlsby. Adaptive Bayesian Quantum Tomography, arXiv 1107.0895
Stage 1: Take measurements up to t
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Adaptive Quantum State Tomography Ferenc Huszár, Neil M. T. Houlsby. Adaptive Bayesian Quantum Tomography, arXiv 1107.0895
Stage 2: Determine the next POVM
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Adaptive Quantum State Tomography Particle bank maintaining and update
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Adaptive Quantum State Tomography Particle bank maintaining and update
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Adaptive Quantum State Tomography Particle bank resampling
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Adaptive Quantum State Tomography
Problem: Computationally expensive
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Our approach Yihui Quek*, Stanislav Fort*, Hui Khoon Ng. Adaptive Quantum State Tomography with Neural Networks, arXiv 1812.06693 Advantages: - Parametrized state ansatz is not required - Exponential computational speedup - Learned directly from simulated data - Can retrain within hours - Any POVM types - Different noise models - Learned distance measure, update rule etc. Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Custom recurrent architecture - off the shelf doesn’t work
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Custom recurrent architecture - off the shelf doesn’t work
Train: Differentiable quantum simulator provides measurement results
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Custom recurrent architecture - off the shelf doesn’t work
Train: Differentiable quantum simulator provides measurement results
Test: Experimenter provides measurement results
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens Veil of ignorance = gradient stop
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Different paradigm from ABQT
● No explicit Bayesian interpretation - weights are just weights ● Automatically learned NN similarity metric for resampling and weight updates ● Resampling is fast ● End-to-end training minimizing arbitrary human choices
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) How is it trained? 2 notions of “time” Inference step
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) How is it trained? 2 notions of “time” Backprop step
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Numerical experiments - what can be varied?
1) Single-qubit POVM type: 2 (basis POVM), 3, 4 (SIC), and 6 (Pauli) legs per qubit subspace
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Numerical experiments - what can be varied?
1) Single-qubit POVM type: 2 (basis POVM), 3, 4 (SIC), and 6 (Pauli) legs per qubit subspace
2) POVM Adaptivity: Adaptive or random measurements? What are the benefits?
3) 3) Reconstruction algorithm: Standard QST, ABQT, or our NA-QST
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute
Number of measurements
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute
Reconstruction error
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute
NA-QST is:
1) Equal in reconstruction accuracy
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute
NA-QST is:
1) Equal in reconstruction accuracy
2) Orders of magnitude faster!
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute
NA-QST is:
1) Equal in reconstruction accuracy
2) Orders of magnitude faster!
3) Time complexity scales better
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) Time complexity scaling: polynomial to logarithmic
ABQT: polynomial time scaling
NA-QST: logarithmic time scaling
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Neural Adaptive Quantum State Tomography (NA-QST) When does adaptivity help?
Conclusions:
- 2 legs (basis): Adaptivity helps a lot
- 3 legs: Adaptive helps slightly
- 4 legs and above (informationally complete): Adaptivity does not make any difference
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA Takeaways and thank you! We designed, implemented, and tested an end-to-end trainable, deep learning powered algorithm called Neural Adaptive Quantum State Tomography (NA-QST)
Primarily based on
arXiv 1812.06693 NA-QST is:
1) Fast to train (hours on a laptop) 2) Very fast to run (poly → log) 3) Accurate in reconstruction (~SOTA) 4) Flexible (noise, different POVMs etc)
Future: Retraining for downstream products involving the density matrix
Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA