Experimental quantum speed-up in reinforcement learning agents.

As the field of artificial intelligence advances, the demand for algorithms that can learn quickly and efficiently increases. An important paradigm within artificial intelligence is reinforcement learning1, where decision-making entities called agents interact with environments and learn by updating their behaviour on the basis of the obtained feedback. The crucial question for practical applications is how fast agents learn2. Although various studies have made use of quantum mechanics to speed up the agent's decision-making process3,4, a reduction in learning time has not yet been demonstrated. Here we present a reinforcement learning experiment in which the learning process of an agent is sped up by using a quantum communication channel with the environment. We further show that combining this scenario with classical communication enables the evaluation of this improvement and allows optimal control of the learning progress. We implement this learning protocol on a compact and fully tunable integrated nanophotonic processor. The device interfaces with telecommunication-wavelength photons and features a fast active-feedback mechanism, demonstrating the agent's systematic quantum advantage in a setup that could readily be integrated within future large-scale quantum communication networks.

On the convergence of projective-simulation-based reinforcement learning in Markov decision processes.

In recent years, the interest in leveraging quantum effects for enhancing machine learning tasks has significantly increased. Many algorithms speeding up supervised and unsupervised learning were established. The first framework in which ways to exploit quantum resources specifically for the broader context of reinforcement learning were found is projective simulation. Projective simulation presents an agent-based reinforcement learning approach designed in a manner which may support quantum walk-based speedups. Although classical variants of projective simulation have been benchmarked against common reinforcement learning algorithms, very few formal theoretical analyses have been provided for its performance in standard learning scenarios. In this paper, we provide a detailed formal discussion of the properties of this model. Specifically, we prove that one version of the projective simulation model, understood as a reinforcement learning approach, converges to optimal behavior in a large class of Markov decision processes. This proof shows that a physically inspired approach to reinforcement learning can guarantee to converge.

Long-Range Big Quantum-Data Transmission.

We introduce an alternative type of quantum repeater for long-range quantum communication with improved scaling with the distance. We show that by employing hashing, a deterministic entanglement distillation protocol with one-way communication, one obtains a scalable scheme that allows one to reach arbitrary distances, with constant overhead in resources per repeater station, and ultrahigh rates. In practical terms, we show that, also with moderate resources of a few hundred qubits at each repeater station, one can reach intercontinental distances. At the same time, a measurement-based implementation allows one to tolerate high loss but also operational and memory errors of the order of several percent per qubit. This opens the way for long-distance communication of big quantum data.

Adaptive quantum computation in changing environments using projective simulation.

Quantum information processing devices need to be robust and stable against external noise and internal imperfections to ensure correct operation. In a setting of measurement-based quantum computation, we explore how an intelligent agent endowed with a projective simulator can act as controller to adapt measurement directions to an external stray field of unknown magnitude in a fixed direction. We assess the agent's learning behavior in static and time-varying fields and explore composition strategies in the projective simulator to improve the agent's performance. We demonstrate the applicability by correcting for stray fields in a measurement-based algorithm for Grover's search. Thereby, we lay out a path for adaptive controllers based on intelligent agents for quantum information tasks.

Hybrid architecture for encoded measurement-based quantum computation.

We present a hybrid scheme for quantum computation that combines the modular structure of elementary building blocks used in the circuit model with the advantages of a measurement-based approach to quantum computation. We show how to construct optimal resource states of minimal size to implement elementary building blocks for encoded quantum computation in a measurement-based way, including states for error correction and encoded gates. The performance of the scheme is determined by the quality of the resource states, where within the considered error model a threshold of the order of 10% local noise per particle for fault-tolerant quantum computation and quantum communication.

Experimental violation of multipartite Bell inequalities with trapped ions.

We report on the experimental violation of multipartite Bell inequalities by entangled states of trapped ions. First, we consider resource states for measurement-based quantum computation of between 3 and 7 ions and show that all strongly violate a Bell-type inequality for graph states, where the criterion for violation is a sufficiently high fidelity. Second, we analyze Greenberger-Horne-Zeilinger states of up to 14 ions generated in a previous experiment using stronger Mermin-Klyshko inequalities, and show that in this case the violation of local realism increases exponentially with system size. These experiments represent a violation of multipartite Bell-type inequalities of deterministically prepared entangled states. In addition, the detection loophole is closed.

Approaches to measuring entanglement in chemical magnetometers.

Chemical magnetometers are radical pair systems such as solutions of pyrene and N,N-dimethylaniline (Py-DMA) that show magnetic field effects in their spin dynamics and their fluorescence. We investigate the existence and decay of quantum entanglement in free geminate Py-DMA radical pairs and discuss how entanglement can be assessed in these systems. We provide an entanglement witness and propose possible observables for experimentally estimating entanglement in radical pair systems with isotropic hyperfine couplings. As an application, we analyze how the field dependence of the entanglement lifetime in Py-DMA could in principle be used for magnetometry and illustrate the propagation of measurement errors in this approach.

Measurement-based quantum computation with trapped ions.

Measurement-based quantum computation represents a powerful and flexible framework for quantum information processing, based on the notion of entangled quantum states as computational resources. The most prominent application is the one-way quantum computer, with the cluster state as its universal resource. Here we demonstrate the principles of measurement-based quantum computation using deterministically generated cluster states, in a system of trapped calcium ions. First we implement a universal set of operations for quantum computing. Second we demonstrate a family of measurement-based quantum error correction codes and show their improved performance as the code length is increased. The methods presented can be directly scaled up to generate graph states of several tens of qubits.

Universal and optimal error thresholds for measurement-based entanglement purification.

We investigate measurement-based entanglement purification protocols (EPP) in the presence of local noise and imperfections. We derive a universal, protocol-independent threshold for the required quality of the local resource states, where we show that local noise per particle of up to 24% is tolerable. This corresponds to an increase of the noise threshold by almost an order of magnitude, based on the joint measurement-based implementation of sequential rounds of few-particle EPP. We generalize our results to multipartite EPP, where we encounter similarly high error thresholds.

Heat transport through lattices of quantum harmonic oscillators in arbitrary dimensions.

In d-dimensional lattices of coupled quantum harmonic oscillators, we analyze the heat current caused by two thermal baths of different temperatures, which are coupled to opposite ends of the lattice, with a focus on the validity of Fourier's law of heat conduction. We provide analytical solutions of the heat current through the quantum system in the nonequilibrium steady state using the rotating-wave approximation and bath interactions described by a master equation of Lindblad form. The influence of local dephasing in the transition of ballistic to diffusive transport is investigated.

Open quantum system approach to the modeling of spin recombination reactions.

In theories of spin-dependent radical pair reactions, the time evolution of the radical pair, including the effect of the chemical kinetics, is described by a master equation in the Liouville formalism. For the description of the chemical kinetics, a number of possible reaction operators have been formulated in the literature. In this work, we present a framework that allows for a unified description of the various proposed mechanisms and the forms of reaction operators for the spin-selective recombination processes. On the basis of the concept that master equations can be derived from a microscopic description of the spin system interacting with external degrees of freedom, it is possible to gain insight into the underlying microscopic processes and develop a systematic approach toward determining the specific form of the reaction operator in concrete scenarios.

Quantum computation in correlation space and extremal entanglement.

Recently, a framework was established to systematically construct novel universal resource states for measurement-based quantum computation using techniques involving finitely correlated states. With these methods, universal states were found which are in certain ways much less entangled than the original cluster-state model, and it was hence believed that with this approach, many of the extremal entanglement features of the cluster states could be relaxed. The new resources were constructed as "computationally universal" states-i.e., they allow one to efficiently reproduce the classical output of each quantum computation-whereas the cluster states are universal in a stronger sense since they are "universal state preparators." Here, we show that the new resources are universal state preparators after all, and must therefore exhibit a whole class of extremal entanglement features, similar to the cluster states.

Unifying all classical spin models in a lattice gauge theory.

The partition function of all classical spin models, including all discrete standard statistical models and all Abelian discrete lattice gauge theories (LGTs), is expressed as a special instance of the partition function of the 4D Z2 LGT. This unifies all classical spin models with apparently very different features in a single complete model. This result is applied to establish a new method to compute the mean-field theory of Abelian discrete LGTs with d > or = 4, and to show that computing the partition function of the 4D Z2 LGT is computationally hard (#P hard). The 4D Z2 LGT is also proved to be approximately complete for Abelian continuous models. The proof uses techniques from quantum information.

Completeness of the classical 2D Ising model and universal quantum computation.

We prove that the 2D Ising model is complete in the sense that the partition function of any classical q-state spin model (on an arbitrary graph) can be expressed as a special instance of the partition function of a 2D Ising model with complex inhomogeneous couplings and external fields. In the case where the original model is an Ising or Potts-type model, we find that the corresponding 2D square lattice requires only polynomially more spins with respect to the original one, and we give a constructive method to map such models to the 2D Ising model. For more general models the overhead in system size may be exponential. The results are established by connecting classical spin models with measurement-based quantum computation and invoking the universality of the 2D cluster states.

Classical spin models and the quantum-stabilizer formalism.

We relate a large class of classical spin models, including the inhomogeneous Ising, Potts, and clock models of q-state spins on arbitrary graphs, to problems in quantum physics. More precisely, we show how to express partition functions as inner products between certain quantum-stabilizer states and product states. This connection allows us to use powerful techniques developed in quantum-information theory, such as the stabilizer formalism and classical simulation techniques, to gain general insights into these models in a unified way. We recover and generalize several symmetries and high-low temperature dualities, and we provide an efficient classical evaluation of partition functions for all interaction graphs with a bounded tree-width.

Ground-state approximation for strongly interacting spin systems in arbitrary spatial dimension.

We introduce a variational method for the approximation of ground states of strongly interacting spin systems in arbitrary geometries and spatial dimensions. The approach is based on weighted graph states and superpositions thereof. These states allow for the efficient computation of all local observables (e.g., energy) and include states with diverging correlation length and unbounded multiparticle entanglement. As a demonstration, we apply our approach to the Ising model on 1D, 2D, and 3D square lattices. We also present generalizations to higher spins and continuous-variable systems, which allows for the investigation of lattice field theories.

Spin gases: quantum entanglement driven by classical kinematics.

A spin gas is a natural extension of a classical gas. It consists of a large number of particles whose (random) motion is described classically, but, in addition, have internal (quantum mechanical) degrees of freedom that interact during collisions. For specific types of quantum interactions we determine the entanglement that occurs naturally in such systems. We analyze how the evolution of the quantum state is determined by the underlying classical kinematics of the gas. For the Boltzmann gas, we calculate the rate at which entanglement is produced and characterize the entanglement properties of the equilibrium state.

Entanglement in spin chains and lattices with long-range Ising-type interactions.

We consider N initially disentangled spins, embedded in a ring or d-dimensional lattice of arbitrary geometry, which interact via some long-range Ising-type interaction. We investigate relations between entanglement properties of the resulting states and the distance dependence of the interaction in the limit N-->infinity. We provide a sufficient condition when bipartite entanglement between blocks of L neighboring spins and the remaining system saturates and determine S(L) analytically for special configurations. We find an unbounded increase of S(L) as well as diverging correlation and entanglement length under certain circumstances. For arbitrarily large N, we can efficiently calculate all quantities associated with reduced density operators of up to ten particles.

Stability of macroscopic entanglement under decoherence.

We investigate the lifetime of macroscopic entanglement under the influence of decoherence. For Greenberger-Horne-Zeilinger-type superposition states, we find that the lifetime decreases with the size of the system (i.e., the number of independent degrees of freedom), and the effective number of subsystems that remain entangled decreases with time. For a class of other states (e.g., cluster states), however, we show that the lifetime of entanglement is independent of the size of the system.

Multiparticle entanglement purification for graph states.

We introduce a class of multiparticle entanglement purification protocols that allow us to distill a large class of entangled states. These include cluster states, Greenberger-Horne-Zeilinger states, and various error correction codes all of which belong to the class of two-colorable graph states. We analyze these schemes under realistic conditions and observe that they are scalable; i.e., the threshold value for imperfect local operations does not depend on the number of parties for many of these states. When compared to schemes based on bipartite entanglement purification, the protocol is more efficient and the achievable quality of the purified states is larger. As an application we discuss an experimental realization of the protocol in optical lattices which allows one to purify cluster states.