1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
|
.\"
.\" process_hkl man page
.\"
.\" Copyright © 2012-2021 Deutsches Elektronen-Synchrotron DESY,
.\" a research centre of the Helmholtz Association.
.\"
.\" Part of CrystFEL - crystallography with a FEL
.\"
.TH PROCESS_HKL 1
.SH NAME
process_hkl \- Monte Carlo merging of Bragg intensities
.SH SYNOPSIS
.PP
.B process_hkl
\fB-i\fR \fImypatterns.stream\fR \fB-o\fR \fImydata.hkl\fR \fB-y\fR \fIpointgroup\fR [\fBoptions\fR] \fB...\fR
.PP
.B process_hkl
\fB--help\fR
.SH DESCRIPTION
process_hkl takes a data stream, such as that from \fBindexamajig\fR, and merges
the many individual intensities together to form a single list of reflection
intensities which are useful for crystallography. Merging is done by the Monte
Carlo method, otherwise known as taking the mean of the individual values.
.SH OPTIONS
.PD 0
.IP "\fB-i\fR \fIfilename\fR"
.IP \fB--input=\fR\fIfilename\fR
.PD
Give the name of the input stream. \fB--input=-\fR means to use stdin.
.PD 0
.IP "\fB-o\fR \fIfilename\fR"
.IP \fB--output=\fR\fIfilename\fR
.PD
Give the name of the output file. The default is \fB--output=processed.hkl\fR.
.PD 0
.IP "\fB-y\fR \fIpointgroup\fR"
.IP \fB--symmetry=\fR\fIpointgroup\fR
.PD
Merge according to symmetry \fIpointgroup\fR.
.PD 0
.IP "\fB-g\fR \fIh,k,l\fR"
.IP \fB--histogram=\fR\fIh,k,l\fR
.PD
Calculate a histogram of intensities for \fIh,k,l\fR, which will be written as
\fBhistogram.dat\fR in the current directory.
.PD 0
.IP "\fB-z\fR \fImin,max,nbins\fR"
.IP \fB--hist-parameters=\fR\fImin,max,nbins\fR
.PD
Set the minimum and maximum values, and the number of bins, to \fImin\fR, \fImax\fR and \fInbins\fR, respectively.
.PD 0
.IP \fB--start-after=\fR\fIn\fR
.PD
Ignore the first \fIn\fR crystals in the input. The default is \fB--start-after=0\fR, i.e. start at the beginning.
.PD 0
.IP \fB--stop-after=\fR\fIn\fR
.PD
Stop processing after \fIn\fR crystals have been successfully merged. The default is \fB--stop-after=0\fR, which means to process all the patterns from the start point to the end of the input (see \fB--start-after\fR).
.PD 0
.IP \fB--even-only\fR
.PD
Merge only the even-numbered crystals in the stream. "Even-numbered" is defined simply according to position in the stream, i.e. not according to any serial number. See also \fB--odd-only\fR.
.PD 0
.IP \fB--odd-only\fR
.PD
Merge only the odd-numbered crystals in the stream. "Odd-numbered" is defined simply according to position in the stream, i.e. not according to any serial number. See also \fB--even-only\fR.
.PD 0
.IP \fB--scale\fR
.PD
Perform a second pass through the input, scaling each crystal's intensities to best fit the initial model.
Use \fBpartialator\fR if you need more advanced merging techniques.
.PD 0
.IP \fB--polarisation=\fItype\fR
.PD
Specify the polarisation of the incident radiation. \fItype\fR can be \fBhoriz\fR or \fBvert\fR to indicate 100% polarisation of the electric field in the horizontal plane or vertical plane respectively. Setting \fItype\fR to \fBnone\fR completely disables the polarisation correction (see the note below). Alternatively, \fItype\fR can be a direction followed by a percentage polarisation fraction. For example, \fB45deg90\fR means that 90% of the radiation is polarised with its electric field in a direction 45 degrees from horizontal, and \fB10deg100\fR means that all the radiation is polarised at 10 degrees from horizontal. The angle is specified clockwise from horizontal as viewed along the beam direction, i.e. as shown by the CrystFEL GUI. The beam is unpolarised when the fraction is 50% (equal parts of the radiation have their electric field in the specified plane). If the polarisation fraction is 100%, it can be omitted. For example \fB10deg\fR or \fBhoriz\fR.
Note that \fB--polarisation=none\fR is not the same as, for example, \fB--polarisation=vert50\fR. In the first case, the polarisation correction will be completely disabled. In the other case, the incident beam will be unpolarised, but the polarisation of the diffracted radiation will still be corrected for (the factor of (1+cos^2(2theta))/2 or, equivalently, (2-sin^2(2theta))/2).
The default is \fB--polarisation=horiz\fR.
.PD 0
.IP \fB--no-polarisation\fR
.PD
Synonym for \fB--polarisation=none\fR.
.PD 0
.IP \fB--min-measurements=\fR\fIn\fR
.PD
Include a reflection in the output only if it appears at least least \fIn\fR times. The default is \fB--min-measurements=2\fR.
.PD 0
.IP \fB--min-snr=\fR\fIn\fR
.PD
Use a particular individual reflection intensity measurement only if it exceeds its estimated standard error by at least \fIn\fR. The default is -infinity, i.e. no cutoff.
.IP
\fBWARNING:\fR think very carefully before using this option. It will bias reflections towards more positive values, even where no signal exists, leading to a data set dominated by the background. This can invalidate some of the figures of merit for the merit for data quality while severely compromising the actual quality.
.PD 0
.IP \fB--max-adu=\fR\fIn\fR
.PD
Include reflections only if their peak values were less than \fIn\fR. That means, \fIn\fR is the saturation value of the detector. The default is infinity, i.e. no cutoff.
.PD 0
.IP \fB--min-res=\fR\fIn\fR
.PD
Merge crystals only if they diffract to beyond \fIn\fR Angstroms resolution. The default is infinity, i.e. all crystals are included. The resolution is taken from the diffraction_resolution_limit line in the stream.
.PD 0
.IP \fB--push-res=\fIn\fR
.PD
Merge reflections which are up to \fIn\fR nm^-1 higher than the apparent resolution limit of each individual crystal. \fIn\fR can be negative to merge \fIlower\fR than the apparent resolution limit. The default is \fB--push-res=inf\fR, which means no resolution cutoff at all.
.PD 0
.IP \fB--min-cc=\fIn\fR
.PD
Perform a second pass through the input, merging crystals only if their correlation with the initial model is at least \fIn\fR.
.PD 0
.IP \fB--stat=\fIfilename\fR
.PD
Perform a second pass through the input and, for each crystal merged, write a line to \fIfilename\fR containing the filename, scale factor and correlation coefficient with the initial model. The scale factors will all be 1 unless \fB--scale\fR is also used.
.SH CHOICE OF POINT GROUP FOR MERGING
One of the main features of serial crystallography is that the orientations of
individual crystals are random. That means that the orientation of each
crystal must be determined independently, with no information about its
relationship to the orientation of crystals in other patterns.
Some symmetry classes are merohedral, which means that they have lower symmetry than their lattices. This means that the orientation determined by indexing will have an ambiguity. In such cases, you will need to merge according to corresponding holohedral point group. To determine what this is, consult the tables in \fRtwin-calculator.pdf\fB.
.SH AUTHOR
This page was written by Thomas White.
.SH REPORTING BUGS
Report bugs to <taw@physics.org>, or visit <http://www.desy.de/~twhite/crystfel>.
.SH COPYRIGHT AND DISCLAIMER
Copyright © 2012-2021 Deutsches Elektronen-Synchrotron DESY, a research centre of the Helmholtz Association.
.P
qprocess_hkl, and this manual, are part of CrystFEL.
.P
CrystFEL is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.
.P
CrystFEL is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
.P
You should have received a copy of the GNU General Public License along with CrystFEL. If not, see <http://www.gnu.org/licenses/>.
.SH SEE ALSO
.BR crystfel (7),
.BR indexamajig (5),
.BR compare_hkl (1),
.BR check_hkl (1),
.BR render_hkl (1),
.BR ambigator (1),
.BR partialator (1)
|