2016-12-28 23:54:51 +01:00
|
|
|
\chapter{Complete search}
|
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
\key{Compelete search}
|
|
|
|
is a general method that can be used
|
|
|
|
for solving almost any algorithm problem.
|
|
|
|
The idea is to generate all possible
|
|
|
|
solutions for the problem using brute force,
|
|
|
|
and select the best solution or count the
|
|
|
|
number of solutions, depending on the problem.
|
|
|
|
|
|
|
|
Complete search is a good technique
|
|
|
|
if it is feasible to go through all the solutions,
|
|
|
|
because the search is usually easy to implement
|
|
|
|
and it always gives the correct answer.
|
|
|
|
If complete search is too slow,
|
|
|
|
greedy algorithms or dynamic programming,
|
|
|
|
presented in the next chapters,
|
|
|
|
may be used.
|
|
|
|
|
|
|
|
\section{Generating subsets}
|
|
|
|
|
|
|
|
\index{subset}
|
|
|
|
|
|
|
|
We first consider the case where
|
|
|
|
the possible solutions for the problem
|
|
|
|
are the subsets of a set of $n$ elements.
|
|
|
|
In this case, a complete search algorithm
|
|
|
|
has to generate
|
|
|
|
all $2^n$ subsets of the set.
|
|
|
|
|
|
|
|
\subsubsection{Method 1}
|
|
|
|
|
|
|
|
An elegant way to go through all subsets
|
|
|
|
of a set is to use recursion.
|
|
|
|
The following function \texttt{gen}
|
|
|
|
generates the subsets of the set
|
|
|
|
$\{1,2,\ldots,n\}$.
|
|
|
|
The function maintains a vector \texttt{v}
|
|
|
|
that will contain the elements in the subset.
|
|
|
|
The generation of the subsets
|
|
|
|
begins when the function
|
|
|
|
is called with parameter $1$.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{lstlisting}
|
2017-01-01 18:38:49 +01:00
|
|
|
void gen(int k) {
|
2016-12-28 23:54:51 +01:00
|
|
|
if (k == n+1) {
|
2017-01-01 18:38:49 +01:00
|
|
|
// process subset v
|
2016-12-28 23:54:51 +01:00
|
|
|
} else {
|
2017-01-01 18:38:49 +01:00
|
|
|
gen(k+1);
|
2016-12-28 23:54:51 +01:00
|
|
|
v.push_back(k);
|
2017-01-01 18:38:49 +01:00
|
|
|
gen(k+1);
|
2016-12-28 23:54:51 +01:00
|
|
|
v.pop_back();
|
|
|
|
}
|
|
|
|
}
|
|
|
|
\end{lstlisting}
|
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
The parameter $k$ is the number that is the next
|
|
|
|
candidate to be included in the subset.
|
|
|
|
The function branches to two cases:
|
|
|
|
either $k$ is included or it is not included in the subset.
|
|
|
|
Finally, when $k=n+1$, a decision has been made for
|
|
|
|
all the numbers and one subset has been generated.
|
|
|
|
|
|
|
|
For example, when $n=3$, the function calls
|
|
|
|
create a tree illustrated below.
|
|
|
|
At each call, the left branch doesn't include
|
|
|
|
the number and the right branch includes the number
|
|
|
|
in the subset.
|
|
|
|
|
2016-12-28 23:54:51 +01:00
|
|
|
\begin{center}
|
|
|
|
\begin{tikzpicture}[scale=.45]
|
|
|
|
\begin{scope}
|
|
|
|
\small
|
2017-01-01 18:38:49 +01:00
|
|
|
\node at (0,0) {$\texttt{gen}(1)$};
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
\node at (-8,-4) {$\texttt{gen}(2)$};
|
|
|
|
\node at (8,-4) {$\texttt{gen}(2)$};
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\path[draw,thick,->] (0,0-0.5) -- (-8,-4+0.5);
|
|
|
|
\path[draw,thick,->] (0,0-0.5) -- (8,-4+0.5);
|
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
\node at (-12,-8) {$\texttt{gen}(3)$};
|
|
|
|
\node at (-4,-8) {$\texttt{gen}(3)$};
|
|
|
|
\node at (4,-8) {$\texttt{gen}(3)$};
|
|
|
|
\node at (12,-8) {$\texttt{gen}(3)$};
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\path[draw,thick,->] (-8,-4-0.5) -- (-12,-8+0.5);
|
|
|
|
\path[draw,thick,->] (-8,-4-0.5) -- (-4,-8+0.5);
|
|
|
|
\path[draw,thick,->] (8,-4-0.5) -- (4,-8+0.5);
|
|
|
|
\path[draw,thick,->] (8,-4-0.5) -- (12,-8+0.5);
|
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
\node at (-14,-12) {$\texttt{gen}(4)$};
|
|
|
|
\node at (-10,-12) {$\texttt{gen}(4)$};
|
|
|
|
\node at (-6,-12) {$\texttt{gen}(4)$};
|
|
|
|
\node at (-2,-12) {$\texttt{gen}(4)$};
|
|
|
|
\node at (2,-12) {$\texttt{gen}(4)$};
|
|
|
|
\node at (6,-12) {$\texttt{gen}(4)$};
|
|
|
|
\node at (10,-12) {$\texttt{gen}(4)$};
|
|
|
|
\node at (14,-12) {$\texttt{gen}(4)$};
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\node at (-14,-13.5) {$\emptyset$};
|
|
|
|
\node at (-10,-13.5) {$\{3\}$};
|
|
|
|
\node at (-6,-13.5) {$\{2\}$};
|
|
|
|
\node at (-2,-13.5) {$\{2,3\}$};
|
|
|
|
\node at (2,-13.5) {$\{1\}$};
|
|
|
|
\node at (6,-13.5) {$\{1,3\}$};
|
|
|
|
\node at (10,-13.5) {$\{1,2\}$};
|
|
|
|
\node at (14,-13.5) {$\{1,2,3\}$};
|
|
|
|
|
|
|
|
|
|
|
|
\path[draw,thick,->] (-12,-8-0.5) -- (-14,-12+0.5);
|
|
|
|
\path[draw,thick,->] (-12,-8-0.5) -- (-10,-12+0.5);
|
|
|
|
\path[draw,thick,->] (-4,-8-0.5) -- (-6,-12+0.5);
|
|
|
|
\path[draw,thick,->] (-4,-8-0.5) -- (-2,-12+0.5);
|
|
|
|
\path[draw,thick,->] (4,-8-0.5) -- (2,-12+0.5);
|
|
|
|
\path[draw,thick,->] (4,-8-0.5) -- (6,-12+0.5);
|
|
|
|
\path[draw,thick,->] (12,-8-0.5) -- (10,-12+0.5);
|
|
|
|
\path[draw,thick,->] (12,-8-0.5) -- (14,-12+0.5);
|
|
|
|
\end{scope}
|
|
|
|
\end{tikzpicture}
|
|
|
|
\end{center}
|
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
\subsubsection{Method 2}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
Another way to generate the subsets is to exploit
|
|
|
|
the bit representation of integers.
|
|
|
|
Each subset of a set of $n$ elements
|
|
|
|
can be represented as a sequence of $n$ bits,
|
|
|
|
which corresponds to an integer between $0 \ldots 2^n-1$.
|
|
|
|
The ones in the bit representation indicate
|
|
|
|
which elements of the set are included in the subset.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
The usual interpretation is that element $k$
|
|
|
|
is included in the subset if $k$th bit from the
|
|
|
|
end of the bit sequence is one.
|
|
|
|
For example, the bit representation of 25
|
|
|
|
is 11001 that corresponds to the subset $\{1,4,5\}$.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
The following iterates through all subsets
|
|
|
|
of a set of $n$ elements
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{lstlisting}
|
|
|
|
for (int b = 0; b < (1<<n); b++) {
|
2017-01-01 18:38:49 +01:00
|
|
|
// process subset b
|
2016-12-28 23:54:51 +01:00
|
|
|
}
|
|
|
|
\end{lstlisting}
|
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
The following code converts each bit
|
|
|
|
representation to a vector \texttt{v}
|
|
|
|
that contains the elements in the subset.
|
|
|
|
This can be done by checking which bits
|
|
|
|
are one in the bit representation.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{lstlisting}
|
|
|
|
for (int b = 0; b < (1<<n); b++) {
|
|
|
|
vector<int> v;
|
|
|
|
for (int i = 0; i < n; i++) {
|
|
|
|
if (b&(1<<i)) v.push_back(i+1);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
\end{lstlisting}
|
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
\section{Generating permutations}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
\index{permutation}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
Another common situation is that the solutions
|
|
|
|
for the problem are permutations of a
|
|
|
|
set of $n$ elements.
|
|
|
|
In this case, a complete search algorithm has to
|
|
|
|
generate $n!$ possible permutations.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
\subsubsection{Method 1}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
Like subsets, permutations can be generated
|
|
|
|
using recursion.
|
|
|
|
The following function \texttt{gen} iterates
|
|
|
|
through the permutations of the set $\{1,2,\ldots,n\}$.
|
|
|
|
The function uses the vector \texttt{v}
|
|
|
|
for storing the permutations, and the generation
|
|
|
|
begins by calling the function without parameters.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{lstlisting}
|
|
|
|
void haku() {
|
|
|
|
if (v.size() == n) {
|
2017-01-01 18:38:49 +01:00
|
|
|
// process permutation v
|
2016-12-28 23:54:51 +01:00
|
|
|
} else {
|
|
|
|
for (int i = 1; i <= n; i++) {
|
|
|
|
if (p[i]) continue;
|
|
|
|
p[i] = 1;
|
|
|
|
v.push_back(i);
|
|
|
|
haku();
|
|
|
|
p[i] = 0;
|
|
|
|
v.pop_back();
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
\end{lstlisting}
|
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
Each function call adds a new element to
|
|
|
|
the permutation in the vector \texttt{v}.
|
|
|
|
The array \texttt{p} indicates which
|
|
|
|
elements are already included in the permutation.
|
|
|
|
If $\texttt{p}[k]=0$, element $k$ is not included,
|
|
|
|
and if $\texttt{p}[k]=1$, element $k$ is included.
|
|
|
|
If the size of the vector equals the size of the set,
|
|
|
|
a permutation has been generated.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
\subsubsection{Method 2}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\index{next\_permutation@\texttt{next\_permutation}}
|
|
|
|
|
2017-01-01 18:38:49 +01:00
|
|
|
Another method is to begin from permutation
|
|
|
|
$\{1,2,\ldots,n\}$ and at each step generate the
|
|
|
|
next permutation in increasing order.
|
|
|
|
The C++ standard library contains the function
|
|
|
|
\texttt{next\_permutation} that can be used for this.
|
|
|
|
The following code generates the permutations
|
|
|
|
of the set $\{1,2,\ldots,n\}$ using the function:
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{lstlisting}
|
|
|
|
vector<int> v;
|
|
|
|
for (int i = 1; i <= n; i++) {
|
|
|
|
v.push_back(i);
|
|
|
|
}
|
|
|
|
do {
|
2017-01-01 18:38:49 +01:00
|
|
|
// process permutation v
|
2016-12-28 23:54:51 +01:00
|
|
|
} while (next_permutation(v.begin(),v.end()));
|
|
|
|
\end{lstlisting}
|
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
\section{Backtracking}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
\index{backtracking}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
A \key{backtracking} algorithm
|
|
|
|
begins from an empty solution
|
|
|
|
and extends the solution step by step.
|
|
|
|
At each step, the search branches
|
|
|
|
to all possible directions how the solution
|
|
|
|
can be extended.
|
|
|
|
After processing one branch, the search
|
|
|
|
continues to other possible directions.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
\index{queen problem}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
As an example, consider the \key{queen problem}
|
|
|
|
where our task is to calculate the number
|
|
|
|
of ways we can place $n$ queens to
|
|
|
|
an $n \times n$ chessboard so that
|
|
|
|
no two queens attack each other.
|
|
|
|
For example, when $n=4$,
|
|
|
|
there are two possible solutions for the problem:
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{center}
|
|
|
|
\begin{tikzpicture}[scale=.65]
|
|
|
|
\begin{scope}
|
|
|
|
\draw (0, 0) grid (4, 4);
|
|
|
|
\node at (1.5,3.5) {$K$};
|
|
|
|
\node at (3.5,2.5) {$K$};
|
|
|
|
\node at (0.5,1.5) {$K$};
|
|
|
|
\node at (2.5,0.5) {$K$};
|
|
|
|
|
|
|
|
\draw (6, 0) grid (10, 4);
|
|
|
|
\node at (6+2.5,3.5) {$K$};
|
|
|
|
\node at (6+0.5,2.5) {$K$};
|
|
|
|
\node at (6+3.5,1.5) {$K$};
|
|
|
|
\node at (6+1.5,0.5) {$K$};
|
|
|
|
|
|
|
|
\end{scope}
|
|
|
|
\end{tikzpicture}
|
|
|
|
\end{center}
|
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
The problem can be solved using backtracking
|
|
|
|
by placing queens to the board row by row.
|
|
|
|
More precisely, we should place exactly one queen
|
|
|
|
to each row so that no queen attacks
|
|
|
|
any of the queens placed before.
|
|
|
|
A solution is ready when we have placed all
|
|
|
|
$n$ queens to the board.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
For example, when $n=4$, the tree produced by
|
|
|
|
the backtracking algorithm begins like this:
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{center}
|
|
|
|
\begin{tikzpicture}[scale=.55]
|
|
|
|
\begin{scope}
|
|
|
|
\draw (0, 0) grid (4, 4);
|
|
|
|
|
|
|
|
\draw (-9, -6) grid (-5, -2);
|
|
|
|
\draw (-3, -6) grid (1, -2);
|
|
|
|
\draw (3, -6) grid (7, -2);
|
|
|
|
\draw (9, -6) grid (13, -2);
|
|
|
|
|
|
|
|
\node at (-9+0.5,-3+0.5) {$K$};
|
|
|
|
\node at (-3+1+0.5,-3+0.5) {$K$};
|
|
|
|
\node at (3+2+0.5,-3+0.5) {$K$};
|
|
|
|
\node at (9+3+0.5,-3+0.5) {$K$};
|
|
|
|
|
|
|
|
\draw (2,0) -- (-7,-2);
|
|
|
|
\draw (2,0) -- (-1,-2);
|
|
|
|
\draw (2,0) -- (5,-2);
|
|
|
|
\draw (2,0) -- (11,-2);
|
|
|
|
|
|
|
|
\draw (-11, -12) grid (-7, -8);
|
|
|
|
\draw (-6, -12) grid (-2, -8);
|
|
|
|
\draw (-1, -12) grid (3, -8);
|
|
|
|
\draw (4, -12) grid (8, -8);
|
|
|
|
\draw[white] (11, -12) grid (15, -8);
|
|
|
|
\node at (-11+1+0.5,-9+0.5) {$K$};
|
|
|
|
\node at (-6+1+0.5,-9+0.5) {$K$};
|
|
|
|
\node at (-1+1+0.5,-9+0.5) {$K$};
|
|
|
|
\node at (4+1+0.5,-9+0.5) {$K$};
|
|
|
|
\node at (-11+0+0.5,-10+0.5) {$K$};
|
|
|
|
\node at (-6+1+0.5,-10+0.5) {$K$};
|
|
|
|
\node at (-1+2+0.5,-10+0.5) {$K$};
|
|
|
|
\node at (4+3+0.5,-10+0.5) {$K$};
|
|
|
|
|
|
|
|
\draw (-1,-6) -- (-9,-8);
|
|
|
|
\draw (-1,-6) -- (-4,-8);
|
|
|
|
\draw (-1,-6) -- (1,-8);
|
|
|
|
\draw (-1,-6) -- (6,-8);
|
|
|
|
|
|
|
|
\node at (-9,-13) {\ding{55}};
|
|
|
|
\node at (-4,-13) {\ding{55}};
|
|
|
|
\node at (1,-13) {\ding{55}};
|
|
|
|
\node at (6,-13) {\ding{51}};
|
|
|
|
|
|
|
|
\end{scope}
|
|
|
|
\end{tikzpicture}
|
|
|
|
\end{center}
|
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
At the bottom level, the three first subsolutions
|
|
|
|
are not valid because the queens attack each other.
|
|
|
|
However, the fourth subsolution is valid
|
|
|
|
and it can be extended to a full solution by
|
|
|
|
placing two more queens to the board.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{samepage}
|
2017-01-01 19:47:18 +01:00
|
|
|
The following code implements the search:
|
2016-12-28 23:54:51 +01:00
|
|
|
\begin{lstlisting}
|
2017-01-01 19:47:18 +01:00
|
|
|
void search(int y) {
|
2016-12-28 23:54:51 +01:00
|
|
|
if (y == n) {
|
|
|
|
c++;
|
|
|
|
return;
|
|
|
|
}
|
|
|
|
for (int x = 0; x < n; x++) {
|
|
|
|
if (r1[x] || r2[x+y] || r3[x-y+n-1]) continue;
|
|
|
|
r1[x] = r2[x+y] = r3[x-y+n-1] = 1;
|
2017-01-01 19:47:18 +01:00
|
|
|
search(y+1);
|
2016-12-28 23:54:51 +01:00
|
|
|
r1[x] = r2[x+y] = r3[x-y+n-1] = 0;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
\end{lstlisting}
|
|
|
|
\end{samepage}
|
2017-01-01 19:47:18 +01:00
|
|
|
The search begins by calling \texttt{search(0)}.
|
|
|
|
The size of the board is in the variable $n$,
|
|
|
|
and the code calculates the number of solutions
|
|
|
|
to the variable $c$.
|
|
|
|
|
|
|
|
The code assumes that the rows and columns
|
|
|
|
of the board are numbered from 0.
|
|
|
|
The function places a queen to row $y$
|
|
|
|
when $0 \le y < n$.
|
|
|
|
Finally, if $y=n$, one solution has been found
|
|
|
|
and the variable $c$ is increased by one.
|
|
|
|
|
|
|
|
The array \texttt{r1} keeps track of the columns
|
|
|
|
that already contain a queen.
|
|
|
|
Similarly, the arrays \texttt{r2} and \texttt{r3}
|
|
|
|
keep track of the diagonals.
|
|
|
|
It is not allowed to add another queen to a
|
|
|
|
column or to a diagonal.
|
|
|
|
For example, the rows and the diagonals of
|
|
|
|
the $4 \times 4$ board are numbered as follows:
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{center}
|
|
|
|
\begin{tikzpicture}[scale=.65]
|
|
|
|
\begin{scope}
|
|
|
|
\draw (0-6, 0) grid (4-6, 4);
|
|
|
|
\node at (-6+0.5,3.5) {$0$};
|
|
|
|
\node at (-6+1.5,3.5) {$1$};
|
|
|
|
\node at (-6+2.5,3.5) {$2$};
|
|
|
|
\node at (-6+3.5,3.5) {$3$};
|
|
|
|
\node at (-6+0.5,2.5) {$0$};
|
|
|
|
\node at (-6+1.5,2.5) {$1$};
|
|
|
|
\node at (-6+2.5,2.5) {$2$};
|
|
|
|
\node at (-6+3.5,2.5) {$3$};
|
|
|
|
\node at (-6+0.5,1.5) {$0$};
|
|
|
|
\node at (-6+1.5,1.5) {$1$};
|
|
|
|
\node at (-6+2.5,1.5) {$2$};
|
|
|
|
\node at (-6+3.5,1.5) {$3$};
|
|
|
|
\node at (-6+0.5,0.5) {$0$};
|
|
|
|
\node at (-6+1.5,0.5) {$1$};
|
|
|
|
\node at (-6+2.5,0.5) {$2$};
|
|
|
|
\node at (-6+3.5,0.5) {$3$};
|
|
|
|
|
|
|
|
\draw (0, 0) grid (4, 4);
|
|
|
|
\node at (0.5,3.5) {$0$};
|
|
|
|
\node at (1.5,3.5) {$1$};
|
|
|
|
\node at (2.5,3.5) {$2$};
|
|
|
|
\node at (3.5,3.5) {$3$};
|
|
|
|
\node at (0.5,2.5) {$1$};
|
|
|
|
\node at (1.5,2.5) {$2$};
|
|
|
|
\node at (2.5,2.5) {$3$};
|
|
|
|
\node at (3.5,2.5) {$4$};
|
|
|
|
\node at (0.5,1.5) {$2$};
|
|
|
|
\node at (1.5,1.5) {$3$};
|
|
|
|
\node at (2.5,1.5) {$4$};
|
|
|
|
\node at (3.5,1.5) {$5$};
|
|
|
|
\node at (0.5,0.5) {$3$};
|
|
|
|
\node at (1.5,0.5) {$4$};
|
|
|
|
\node at (2.5,0.5) {$5$};
|
|
|
|
\node at (3.5,0.5) {$6$};
|
|
|
|
|
|
|
|
\draw (6, 0) grid (10, 4);
|
|
|
|
\node at (6.5,3.5) {$3$};
|
|
|
|
\node at (7.5,3.5) {$4$};
|
|
|
|
\node at (8.5,3.5) {$5$};
|
|
|
|
\node at (9.5,3.5) {$6$};
|
|
|
|
\node at (6.5,2.5) {$2$};
|
|
|
|
\node at (7.5,2.5) {$3$};
|
|
|
|
\node at (8.5,2.5) {$4$};
|
|
|
|
\node at (9.5,2.5) {$5$};
|
|
|
|
\node at (6.5,1.5) {$1$};
|
|
|
|
\node at (7.5,1.5) {$2$};
|
|
|
|
\node at (8.5,1.5) {$3$};
|
|
|
|
\node at (9.5,1.5) {$4$};
|
|
|
|
\node at (6.5,0.5) {$0$};
|
|
|
|
\node at (7.5,0.5) {$1$};
|
|
|
|
\node at (8.5,0.5) {$2$};
|
|
|
|
\node at (9.5,0.5) {$3$};
|
|
|
|
|
|
|
|
\node at (-4,-1) {\texttt{r1}};
|
|
|
|
\node at (2,-1) {\texttt{r2}};
|
|
|
|
\node at (8,-1) {\texttt{r3}};
|
|
|
|
|
|
|
|
\end{scope}
|
|
|
|
\end{tikzpicture}
|
|
|
|
\end{center}
|
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
Using the presented backtracking
|
|
|
|
algorithm, we can calculate that,
|
|
|
|
for example, there are 92 ways to place 8
|
|
|
|
queens to an $8 \times 8$ chessboard.
|
|
|
|
When $n$ increases, the search quickly becomes slow
|
|
|
|
because the number of the solutions increases
|
|
|
|
exponentially.
|
|
|
|
For example, calculating the ways to
|
|
|
|
place 16 queens to the $16 \times 16$
|
|
|
|
chessboard already takes about a minute
|
|
|
|
(there are 14772512 solutions).
|
|
|
|
|
|
|
|
\section{Pruning the search}
|
|
|
|
|
|
|
|
A backtracking algorithm can often be optimized
|
|
|
|
by pruning the search tree.
|
|
|
|
The idea is to add ''intelligence'' to the algorithm
|
|
|
|
so that it will notice as soon as possible
|
|
|
|
if is not possible to extend a subsolution into
|
|
|
|
a full solution.
|
|
|
|
This kind of optimization can have a tremendous
|
|
|
|
effect on the efficiency of the search.
|
|
|
|
|
|
|
|
Let us consider a problem where
|
|
|
|
our task is to calculate the number of paths
|
|
|
|
in an $n \times n$ grid from the upper-left corner
|
|
|
|
to the lower-right corner so that each square
|
|
|
|
will be visited exactly once.
|
|
|
|
For example, in the $7 \times 7$ grid,
|
|
|
|
there are 111712 possible paths from the
|
|
|
|
lower-right corner to the upper-right corner.
|
|
|
|
One of the paths is as follows:
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{center}
|
|
|
|
\begin{tikzpicture}[scale=.55]
|
|
|
|
\begin{scope}
|
|
|
|
\draw (0, 0) grid (7, 7);
|
|
|
|
\draw[thick,->] (0.5,6.5) -- (0.5,4.5) -- (2.5,4.5) --
|
|
|
|
(2.5,3.5) -- (0.5,3.5) -- (0.5,0.5) --
|
|
|
|
(3.5,0.5) -- (3.5,1.5) -- (1.5,1.5) --
|
|
|
|
(1.5,2.5) -- (4.5,2.5) -- (4.5,0.5) --
|
|
|
|
(5.5,0.5) -- (5.5,3.5) -- (3.5,3.5) --
|
|
|
|
(3.5,5.5) -- (1.5,5.5) -- (1.5,6.5) --
|
|
|
|
(4.5,6.5) -- (4.5,4.5) -- (5.5,4.5) --
|
|
|
|
(5.5,6.5) -- (6.5,6.5) -- (6.5,0.5);
|
|
|
|
\end{scope}
|
|
|
|
\end{tikzpicture}
|
|
|
|
\end{center}
|
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
We will concentrate on the $7 \times 7$ case
|
|
|
|
because it is computationally suitable difficult.
|
|
|
|
We begin with a straightforward backtracking algorithm,
|
|
|
|
and then optimize it step by step using observations
|
|
|
|
how the search tree can be pruned.
|
|
|
|
After each optimization, we measure the running time
|
|
|
|
of the algorithm and the number of recursive calls,
|
|
|
|
so that we will clearly see the effect of each
|
|
|
|
optimization on the efficiency of the search.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
\subsubsection{Basic algorithm}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
The first version of the algorithm doesn't contain
|
|
|
|
any optimizations. We simply use backtracking to generate
|
|
|
|
all possible paths from the upper-left corner to
|
|
|
|
the lower-right corner.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{itemize}
|
|
|
|
\item
|
2017-01-01 19:47:18 +01:00
|
|
|
running time: 483 seconds
|
2016-12-28 23:54:51 +01:00
|
|
|
\item
|
2017-01-01 19:47:18 +01:00
|
|
|
recursive calls: 76 billions
|
2016-12-28 23:54:51 +01:00
|
|
|
\end{itemize}
|
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
\subsubsection{Optimization 1}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
The first step in a solution is either
|
|
|
|
downward or to the right.
|
|
|
|
There are always two paths that
|
|
|
|
are symmetric
|
|
|
|
about the diagonal of the grid
|
|
|
|
after the first step.
|
|
|
|
For example, the following paths are symmetric:
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{center}
|
|
|
|
\begin{tabular}{ccc}
|
|
|
|
\begin{tikzpicture}[scale=.55]
|
|
|
|
\begin{scope}
|
|
|
|
\draw (0, 0) grid (7, 7);
|
|
|
|
\draw[thick,->] (0.5,6.5) -- (0.5,4.5) -- (2.5,4.5) --
|
|
|
|
(2.5,3.5) -- (0.5,3.5) -- (0.5,0.5) --
|
|
|
|
(3.5,0.5) -- (3.5,1.5) -- (1.5,1.5) --
|
|
|
|
(1.5,2.5) -- (4.5,2.5) -- (4.5,0.5) --
|
|
|
|
(5.5,0.5) -- (5.5,3.5) -- (3.5,3.5) --
|
|
|
|
(3.5,5.5) -- (1.5,5.5) -- (1.5,6.5) --
|
|
|
|
(4.5,6.5) -- (4.5,4.5) -- (5.5,4.5) --
|
|
|
|
(5.5,6.5) -- (6.5,6.5) -- (6.5,0.5);
|
|
|
|
\end{scope}
|
|
|
|
\end{tikzpicture}
|
|
|
|
& \hspace{20px}
|
|
|
|
&
|
|
|
|
\begin{tikzpicture}[scale=.55]
|
|
|
|
\begin{scope}[yscale=1,xscale=-1,rotate=-90]
|
|
|
|
\draw (0, 0) grid (7, 7);
|
|
|
|
\draw[thick,->] (0.5,6.5) -- (0.5,4.5) -- (2.5,4.5) --
|
|
|
|
(2.5,3.5) -- (0.5,3.5) -- (0.5,0.5) --
|
|
|
|
(3.5,0.5) -- (3.5,1.5) -- (1.5,1.5) --
|
|
|
|
(1.5,2.5) -- (4.5,2.5) -- (4.5,0.5) --
|
|
|
|
(5.5,0.5) -- (5.5,3.5) -- (3.5,3.5) --
|
|
|
|
(3.5,5.5) -- (1.5,5.5) -- (1.5,6.5) --
|
|
|
|
(4.5,6.5) -- (4.5,4.5) -- (5.5,4.5) --
|
|
|
|
(5.5,6.5) -- (6.5,6.5) -- (6.5,0.5);
|
|
|
|
\end{scope}
|
|
|
|
\end{tikzpicture}
|
|
|
|
\end{tabular}
|
|
|
|
\end{center}
|
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
Thus, we can decide that the first step
|
|
|
|
in the solution is always downward,
|
|
|
|
and finally multiply the number of the solutions by two.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{itemize}
|
|
|
|
\item
|
2017-01-01 19:47:18 +01:00
|
|
|
running time: 244 seconds
|
2016-12-28 23:54:51 +01:00
|
|
|
\item
|
2017-01-01 19:47:18 +01:00
|
|
|
recursive calls: 38 billions
|
2016-12-28 23:54:51 +01:00
|
|
|
\end{itemize}
|
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
\subsubsection{Optimization 2}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
If the path reaches the lower-right square
|
|
|
|
before it has visited all other squares of the grid,
|
|
|
|
it is clear that
|
|
|
|
it will not be possible to complete the solution.
|
|
|
|
An example of this is the following case:
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{center}
|
|
|
|
\begin{tikzpicture}[scale=.55]
|
|
|
|
\begin{scope}
|
|
|
|
\draw (0, 0) grid (7, 7);
|
|
|
|
\draw[thick,->] (0.5,6.5) -- (0.5,4.5) -- (2.5,4.5) --
|
|
|
|
(2.5,3.5) -- (0.5,3.5) -- (0.5,0.5) --
|
|
|
|
(3.5,0.5) -- (3.5,1.5) -- (1.5,1.5) --
|
|
|
|
(1.5,2.5) -- (4.5,2.5) -- (4.5,0.5) --
|
|
|
|
(6.5,0.5);
|
|
|
|
\end{scope}
|
|
|
|
\end{tikzpicture}
|
|
|
|
\end{center}
|
2017-01-01 19:47:18 +01:00
|
|
|
Using this observation, we can terminate the search branch
|
|
|
|
immediately if we reach the lower-right square too early.
|
2016-12-28 23:54:51 +01:00
|
|
|
\begin{itemize}
|
|
|
|
\item
|
2017-01-01 19:47:18 +01:00
|
|
|
running time: 119 seconds
|
2016-12-28 23:54:51 +01:00
|
|
|
\item
|
2017-01-01 19:47:18 +01:00
|
|
|
recursive calls: 20 billions
|
2016-12-28 23:54:51 +01:00
|
|
|
\end{itemize}
|
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
\subsubsection{Optimization 3}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
If the path touches the wall so that there is
|
|
|
|
an unvisited square at both sides,
|
|
|
|
the grid splits into two parts.
|
|
|
|
For example, in the following case
|
|
|
|
both the left and the right squares
|
|
|
|
are unvisited:
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{center}
|
|
|
|
\begin{tikzpicture}[scale=.55]
|
|
|
|
\begin{scope}
|
|
|
|
\draw (0, 0) grid (7, 7);
|
|
|
|
\draw[thick,->] (0.5,6.5) -- (0.5,4.5) -- (2.5,4.5) --
|
|
|
|
(2.5,3.5) -- (0.5,3.5) -- (0.5,0.5) --
|
|
|
|
(3.5,0.5) -- (3.5,1.5) -- (1.5,1.5) --
|
|
|
|
(1.5,2.5) -- (4.5,2.5) -- (4.5,0.5) --
|
|
|
|
(5.5,0.5) -- (5.5,6.5);
|
|
|
|
\end{scope}
|
|
|
|
\end{tikzpicture}
|
|
|
|
\end{center}
|
2017-01-01 19:47:18 +01:00
|
|
|
Now it will not be possible to visit every square,
|
|
|
|
so we can terminate the search branch.
|
|
|
|
This optimization is very useful:
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{itemize}
|
|
|
|
\item
|
2017-01-01 19:47:18 +01:00
|
|
|
running time: 1.8 seconds
|
2016-12-28 23:54:51 +01:00
|
|
|
\item
|
2017-01-01 19:47:18 +01:00
|
|
|
recursive calls: 221 millions
|
2016-12-28 23:54:51 +01:00
|
|
|
\end{itemize}
|
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
\subsubsection{Optimization 4}
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
The idea of the previous optimization
|
|
|
|
can be generalized:
|
|
|
|
the grid splits into two parts
|
|
|
|
if the top and bottom neighbors
|
|
|
|
of the current square are unvisited and
|
|
|
|
the left and right neighbors are
|
|
|
|
wall or visited (or vice versa).
|
2016-12-28 23:54:51 +01:00
|
|
|
|
2017-01-01 19:47:18 +01:00
|
|
|
For example, in the following case
|
|
|
|
the top and bottom neighbors are unvisited,
|
|
|
|
so the path cannot visit all squares
|
|
|
|
in the grid anymore:
|
2016-12-28 23:54:51 +01:00
|
|
|
\begin{center}
|
|
|
|
\begin{tikzpicture}[scale=.55]
|
|
|
|
\begin{scope}
|
|
|
|
\draw (0, 0) grid (7, 7);
|
|
|
|
\draw[thick,->] (0.5,6.5) -- (0.5,4.5) -- (2.5,4.5) --
|
|
|
|
(2.5,3.5) -- (0.5,3.5) -- (0.5,0.5) --
|
|
|
|
(3.5,0.5) -- (3.5,1.5) -- (1.5,1.5) --
|
|
|
|
(1.5,2.5) -- (4.5,2.5) -- (4.5,0.5) --
|
|
|
|
(5.5,0.5) -- (5.5,4.5) -- (3.5,4.5);
|
|
|
|
\end{scope}
|
|
|
|
\end{tikzpicture}
|
|
|
|
\end{center}
|
2017-01-01 19:47:18 +01:00
|
|
|
The search becomes even faster when we terminate
|
|
|
|
the search branch in all such cases:
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\begin{itemize}
|
|
|
|
\item
|
2017-01-01 19:47:18 +01:00
|
|
|
running time: 0.6 seconds
|
2016-12-28 23:54:51 +01:00
|
|
|
\item
|
2017-01-01 19:47:18 +01:00
|
|
|
recursive calls: 69 millions
|
2016-12-28 23:54:51 +01:00
|
|
|
\end{itemize}
|
|
|
|
|
|
|
|
~\\
|
2017-01-01 19:47:18 +01:00
|
|
|
Now it's a good moment to stop optimization
|
|
|
|
and remember our starting point.
|
|
|
|
The running time of the original algorithm
|
|
|
|
was 483 seconds,
|
|
|
|
and now after the optimizations,
|
|
|
|
the running time is only 0.6 seconds.
|
|
|
|
Thus, the algorithm became nearly 1000 times
|
|
|
|
faster after the optimizations.
|
|
|
|
|
|
|
|
This is a usual phenomenon in backtracking
|
|
|
|
because the search tree is usually large
|
|
|
|
and even simple optimizations can prune
|
|
|
|
a lot of branches in the tree.
|
|
|
|
Especially useful are optimizations that
|
|
|
|
occur at the top of the search tree because
|
|
|
|
they can prune the search very efficiently.
|
2016-12-28 23:54:51 +01:00
|
|
|
|
|
|
|
\section{Puolivälihaku}
|
|
|
|
|
|
|
|
\index{puolivxlihaku@puolivälihaku}
|
|
|
|
|
|
|
|
\key{Puolivälihaku} (''meet in the middle'') on tekniikka,
|
|
|
|
jossa hakutehtävä jaetaan kahteen yhtä suureen osaan.
|
|
|
|
Kumpaankin osaan tehdään erillinen haku,
|
|
|
|
ja lopuksi hakujen tulokset yhdistetään.
|
|
|
|
|
|
|
|
Puolivälihaun käyttäminen edellyttää,
|
|
|
|
että erillisten hakujen tulokset pystyy
|
|
|
|
yhdistämään tehokkaasti.
|
|
|
|
Tällöin puolivälihaku on tehokkaampi
|
|
|
|
kuin yksi haku, joka käy läpi koko hakualueen.
|
|
|
|
Tyypillisesti puolivälihaku tehostaa algoritmia
|
|
|
|
niin, että aikavaativuuden kertoimesta $2^n$
|
|
|
|
tulee kerroin $2^{n/2}$.
|
|
|
|
|
|
|
|
Tarkastellaan ongelmaa, jossa annettuna
|
|
|
|
on $n$ lukua sisältävä lista sekä kokonaisluku $x$.
|
|
|
|
Tehtävänä on selvittää, voiko listalta valita
|
|
|
|
joukon lukuja niin, että niiden summa on $x$.
|
|
|
|
Esimerkiksi jos lista on $[2,4,5,9]$ ja $x=15$,
|
|
|
|
voimme valita listalta luvut $[2,4,9]$,
|
|
|
|
jolloin $2+4+9=15$.
|
|
|
|
Jos taas lista säilyy ennallaan ja $x=10$,
|
|
|
|
mikään valinta ei täytä vaatimusta.
|
|
|
|
|
|
|
|
Tavanomainen ratkaisu tehtävään on käydä kaikki
|
|
|
|
listan alkioiden osajoukot läpi ja tarkastaa,
|
|
|
|
onko jonkin osajoukon summa $x$.
|
|
|
|
Tällainen ratkaisu kuluttaa aikaa $O(2^n)$,
|
|
|
|
koska erilaisia osajoukkoja on $2^n$.
|
|
|
|
Seuraavaksi näemme,
|
|
|
|
miten puolivälihaun avulla on mahdollista luoda
|
|
|
|
tehokkaampi $O(2^{n/2})$-aikainen ratkaisu.
|
|
|
|
Huomaa, että aikavaativuuksissa $O(2^n)$ ja
|
|
|
|
$O(2^{n/2})$ on merkittävä ero, koska
|
|
|
|
$2^{n/2}$ tarkoittaa samaa kuin $\sqrt{2^n}$.
|
|
|
|
|
|
|
|
Ideana on jakaa syötteenä oleva lista
|
|
|
|
kahteen listaan $A$ ja $B$,
|
|
|
|
joista kumpikin sisältää noin puolet luvuista.
|
|
|
|
Ensimmäinen haku muodostaa kaikki osajoukot
|
|
|
|
listan $A$ luvuista ja laittaa muistiin niiden summat
|
|
|
|
listaan $S_A$.
|
|
|
|
Toinen haku muodostaa vastaavasti listan
|
|
|
|
$B$ perusteella listan $S_B$.
|
|
|
|
Tämän jälkeen riittää tarkastaa,
|
|
|
|
onko mahdollista valita yksi luku listasta $S_A$
|
|
|
|
ja toinen luku listasta $S_B$ niin,
|
|
|
|
että lukujen summa on $x$.
|
|
|
|
Tämä on mahdollista tarkalleen silloin,
|
|
|
|
kun alkuperäisen listan luvuista saa summan $x$.
|
|
|
|
|
|
|
|
Tarkastellaan esimerkkiä,
|
|
|
|
jossa lista on $[2,4,5,9]$
|
|
|
|
ja $x=15$.
|
|
|
|
Puolivälihaku jakaa luvut kahteen
|
|
|
|
listaan niin, että $A=[2,4]$
|
|
|
|
ja $B=[5,9]$.
|
|
|
|
Näistä saadaan edelleen summalistat
|
|
|
|
$S_A=[0,2,4,6]$ ja $S_B=[0,5,9,14]$.
|
|
|
|
Summa $x=15$ on mahdollista muodostaa,
|
|
|
|
koska voidaan valita $S_A$:sta luku $6$
|
|
|
|
ja $S_B$:stä luku $9$.
|
|
|
|
Tämä valinta vastaa ratkaisua $[2,4,9]$.
|
|
|
|
|
|
|
|
Ratkaisun aikavaativuus on $O(2^{n/2})$,
|
|
|
|
koska kummassakin listassa $A$ ja $B$
|
|
|
|
on $n/2$ lukua ja niiden osajoukkojen
|
|
|
|
summien laskeminen listoihin $S_A$ ja $S_B$
|
|
|
|
vie aikaa $O(2^{n/2})$.
|
|
|
|
Tämän jälkeen on mahdollista tarkastaa
|
|
|
|
ajassa $O(2^{n/2})$, voiko summaa $x$ muodostaa
|
|
|
|
listojen $S_A$ ja $S_B$ luvuista.
|