SVG-Viewer needed.

SVG-Viewer needed.

Complexity Class: PP

Nathan Stefanik and Yukun Zheng
Georgia Institute of Technology
13 December 2021
Table of Contents

History

History

History

History

History

Probabilistic Turing Machines

A probabilistic Turing machine M is a type of nondeterministic Turing machine in which each nondeterministic step is called a coin-flip step and has two legal next moves. We assign a probability to each branch b of M’s computation on input w as follows. Define the probability of branch b to be

Pr [b] = 2-k

where k is the number of coin-flip steps that occur on branch b. Define the probability that M accepts w to be

                        ∑
Pr[M accepts w] =                  Pr[b ].
                  b is an accepting branch
Definition of PP

A language L is in PP if and only if there exists a probabilistic Turing machine M, such that

SVG-Viewer needed.

M runs for polynomial time on all inputs

SVG-Viewer needed.

For all x in L, M outputs 1 with probability strictly greater than 12

SVG-Viewer needed.

For all x not in L, M outputs 1 with probability less than or equal to 12.

x ∈ L ⇐ ⇒  {y ∈ {0,1}p(|x|) : M (x,y) = 1 } ≥ 1⋅2p(|x|)
                                          2
Complexity Classes

Probabilistic Polynomial time (PP)

SVG-Viewer needed.

Definition

SVG-Viewer needed.

SVG-Viewer needed.

PP is the class of decision problems solvable by a probabilistic Turing machine in polynomial time, with an error probability of less than 1/2 for all instances.

Bounded-error Probabilistic Polynomial time (BPP)

SVG-Viewer needed.

Definition

SVG-Viewer needed.

SVG-Viewer needed.

BPP is the class of decision problems solvable by a probabilistic Turing machine in polynomial time, with an error probability of less than 1/3 for all instances.

Complexity Classes Relationship

PIC
Theorem 1

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

BPPPPPSPACE

SVG-Viewer needed.

Proof.

SVG-Viewer needed.

SVG-Viewer needed.

The first inclusion follows from definition. It is left for the reader to show the second inclusion by considering a PPT Turing machine M that can solve a reduced problem (which one?). Thus, PP PSPACE. __

Hint: MAJSAT

Theorem 1

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

BPPPPPSPACE

SVG-Viewer needed.

Proof.

SVG-Viewer needed.

SVG-Viewer needed.

The first inclusion follows from definition. It is left for the reader to show the second inclusion by considering a PPT Turing machine M that can solve a reduced problem (which one?). Thus, PP PSPACE. __

Hint: MAJSAT

Theorem 2

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

N PPP

SVG-Viewer needed.

Definition

SVG-Viewer needed.

SVG-Viewer needed.

From Sipser, a witness is a number that is used in our algorithm to accept or reject a proposed solution. In other words, it acts like a check in our process.

Theorem 2

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

N PPP

SVG-Viewer needed.

Proof.

SVG-Viewer needed.

SVG-Viewer needed.

Let L NP with witnesses of size p(|x|). We give a PP algorithm for L on input x:

SVG-Viewer needed.

accept with probability 12 --p(|x|)
2-4---

SVG-Viewer needed.

otherwise, choose a string w ∈{0,1}p(|x|) at random

SVG-Viewer needed.

accept iff w is a witness for input x

(to be cont.)

Theorem 2

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

N PPP

SVG-Viewer needed.

Proof.

SVG-Viewer needed.

SVG-Viewer needed.

(cont.) Thus, if x∕∈L, then the probability that the above algorithm accepts is less than 1
2. If x L, then there exists at least one witness such that the probability of acceptance is
1   2- p(|x|)   2-p(|x|)   1
--- -------+  -------> -.
2      4        2      2
__
Theorem 3: Preliminaries

First,

SVG-Viewer needed.

Definition

SVG-Viewer needed.

SVG-Viewer needed.

Σ0 P = Π0P = P
Σk+1P := PΣkP
Πk+1P := PΠkP
where

PL := {x ∈{0,1}*w ∈{0,1}p(|x|) such that < x,w >L}
PL := {x ∈{0,1}*w ∈{0,1}p(|x|) such that < x,w >L}

Notice that Σ1P = NP, and Π1P = co - NP.

Theorem 3: Preliminaries

There exists a natural hierarchy in PSPACE.

SVG-Viewer needed.

Definition

SVG-Viewer needed.

SVG-Viewer needed.

The polynomial time hierarchy is a collection of classes defined by
       ⋃        ⋃
PH  =    ΣiP =    ΠiP.
       i         i

Theorem 3: Preliminaries

There exists a natural hierarchy in PSPACE.

SVG-Viewer needed.

Definition

SVG-Viewer needed.

SVG-Viewer needed.

The polynomial time hierarchy is a collection of classes defined by
      ⋃        ⋃
PH  =    ΣiP =    ΠiP.
       i        i

Theorem 3: Toda’s Theorem

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

PP is as hard as the polynomial time hierarchy.

Since #P is equivalent to PP,

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

#P (the class of counting problems) is as hard as the polynomial time hierarchy.

Thus, for every problem in PH there exists a deterministic, polynomial time reduction to a counting problem.

Theorem 3: Toda’s Theorem

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

PP is as hard as the polynomial time hierarchy.

Since #P is equivalent to PP,

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

#P (the class of counting problems) is as hard as the polynomial time hierarchy.

Thus, for every problem in PH there exists a deterministic, polynomial time reduction to a counting problem.

Theorem 3: Toda’s Theorem

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

PP is as hard as the polynomial time hierarchy.

Since #P is equivalent to PP,

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

#P (the class of counting problems) is as hard as the polynomial time hierarchy.

Thus, for every problem in PH there exists a deterministic, polynomial time reduction to a counting problem.

Example 1: Boolean Satisfiability (SAT)

Given a boolean formula F(x1,x2,,xn), can F evaluate to 1 (true)?

SVG-Viewer needed.

Example

SVG-Viewer needed.

SVG-Viewer needed.

(x1 x2) ∨�x3 is a boolean formula. (1,1,0) is a solution.

Example 1: Boolean Satisfiability (SAT)

Given a boolean formula F(x1,x2,,xn), can F evaluate to 1 (true)?

SVG-Viewer needed.

Example

SVG-Viewer needed.

SVG-Viewer needed.

(x1 x2) ∨�x3 is a boolean formula. (1,1,0) is a solution.

Example 1: Boolean Satisfiability (SAT)

Given a boolean formula F(x1,x2,,xn), can F evaluate to 1 (true)?

SVG-Viewer needed.

Example

SVG-Viewer needed.

SVG-Viewer needed.

(x1 x2) ∨�x3 is a boolean formula. (1,1,0) is a solution.

Example 2

MAJSAT is a special case of SAT in which you are given a boolean formula F. The result of the formula must be 1 if more than half of all assignments x1,x2,,xn make F evaluate to 1 and 0 otherwise.

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

MAJSAT is PP-complete.

Proof uses many-to-one Turing reduction.

Example 2

MAJSAT is a special case of SAT in which you are given a boolean formula F. The result of the formula must be 1 if more than half of all assignments x1,x2,,xn make F evaluate to 1 and 0 otherwise.

SVG-Viewer needed.

Theorem

SVG-Viewer needed.

SVG-Viewer needed.

MAJSAT is PP-complete.

Proof uses many-to-one Turing reduction.

References

SVG-Viewer needed.

L. Fortnow, and S. Homer. “A Short History of Computational Complexity - Computer Science,” Computational Complexity Conference (CCC), 2003. Available: https://people.cs.uchicago.edu/ fortnow/beatcs/column80.pdf.

SVG-Viewer needed.

J. Katz, ”Notes on Complexity Theory Handout 7,” The University of Maryland, 2005. Available: https://www.cs.umd.edu/ jkatz/complexity/f05/lecture7.pdf

SVG-Viewer needed.

E. Allender, M. Loui, K. Regan, ”Other Complexity Classes and Measures,” CRC Handbook on Algorithms and Theory of Computations, Ch. 29, January 2007. Available: https://cse.buffalo.edu/ regan/papers/pdf/ALRch29.pdf

SVG-Viewer needed.

S. Toda, ”PP is as Hard as the Polynomial-Time Hierarchy,” Siam Journal on Computing, Vol. 20, No. 5, October 1991. Available: https://epubs.siam.org/doi/pdf/10.1137/0220053