Age | Commit message (Collapse) | Author | |
---|---|---|---|
2021-07-23 | indexamajig: Fix error path when worker pipe is closed mid-chunk | Thomas White | |
2021-07-23 | try_status: Remove duplicate assignment | Thomas White | |
2021-07-21 | Add missing cleanup on error paths | Thomas White | |
2021-05-05 | indexamajig: Add --zmq-request | Thomas White | |
This (re-)adds the ability to get data via a request/reply socket. See afcb7b568947c for when it was removed. | |||
2021-04-23 | indexamajig: Generate a unique filename for ZMQ data | Thomas White | |
The unique filename is needed by the GUI for looking up results in a stream. Otherwise, the filename is "(null)" for everything and the lookup just returns the first chunk in the stream. The filename is generated based on the unique serial number for each chunk, and is therefore unique across one run of indexamajig regardless of the number of worker processes (-j). This might have to change in future to accommodate jobs run across multiple nodes, if there is any demand for looking at results in one big concatenated stream. This also changes the condition for deciding when to look for a 'real' file, to take into account that there is always a non-NULL filename. | |||
2021-04-23 | indexamajig: Mercilessly ignore short ZMQ messages | Thomas White | |
This is a hack to filter out what seems like "keepalive" messages. It's nasty, but better than contaminating the stream with spurious chunks. | |||
2021-04-23 | indexamajig: Add --zmq-subscribe | Thomas White | |
2021-04-20 | Fix memory handling semantics for ZMQ data | Thomas White | |
2021-04-15 | Separate ZMQ from MessagePack, switch to pub/sub socket | Thomas White | |
Indexamajig uses only ZMQ, to receive streaming data, while libcrystfel uses only msgpack to implement another type of image format. The two of these are eventually tied together in process_image, which does this: if ( have_zmq_data ) interpret_zmq_data_as_msgpack; - however, they would be easy to split up if we wanted to do something else (CBF data over ZMQ, anyone?). This commit also switches the ZMQ connector to use a pub/sub socket instead of a request/reply one. This matches changes in OnDA. At the moment, the MessagePack image reader simply dumps the object to disk. | |||
2021-03-31 | indexamajig: Handle spaces in filename when retrieving ID from queue | Thomas White | |
2021-03-05 | Mass update of copyright dates in source code comments | Thomas White | |
2020-09-30 | indexamajig: Don't stop on first multi-frame file with no frames | Thomas White | |
2020-08-19 | Make Stream responsible for its own DataTemplate | Thomas White | |
It makes no sense for a different DataTemplate to be used for every frame in a stream. And this way makes everything much easier for users ot the API. | |||
2020-08-10 | indexamajig: Do not set pgid | Thomas White | |
Bad idea. Prevents Ctrl-C from working at a normal terminal. The GUI will have to find another way to kill indexamajig properly. This reverts c03df15d71cf443f44a438f6d9dd99ab8259bcd5. | |||
2020-07-29 | Remove events.c, part 2 | Thomas White | |
New event parsing, done at the last minute in image-hdf5.c | |||
2020-07-29 | Remove events.c, part 1 | Thomas White | |
2020-07-29 | Convert indexamajig to new Stream API | Thomas White | |
2020-07-29 | Remove references to old headers | Thomas White | |
2020-07-29 | Get rid of imagefile_field_list and stuff_from_stream | Thomas White | |
The only place this is used is in geoptimiser, to get the average_camera_length, itself a very bad solution. | |||
2020-07-29 | Port indexamajig to new API, part I | Thomas White | |
2020-07-29 | Deprecation markers | Thomas White | |
2020-07-29 | indexamajig: Run in own process group | Thomas White | |
Normally, the shell puts indexamajig into its own process group, so that the entire program (including subprocesses) can be killed easily. However, this doesn't happen when running from the GUI. So, it needs to be done manually. | |||
2020-01-10 | Mass update of copyright dates | Thomas White | |
2019-10-17 | indexamajig: Shut down gracefully after failed image load | Thomas White | |
2019-09-23 | Merge branch 'tom/pinkindexer' | Thomas White | |
2019-09-23 | indexamajig: Move 'profile' flag out of iargs | Thomas White | |
2019-09-12 | Increase indexing timeout when using pinkIndexer | Thomas White | |
2019-09-03 | Fix memory leak in event queue | Thomas White | |
2019-03-15 | Set msgpack_obj to NULL when not in use | Thomas White | |
2019-03-14 | Process ZMQ data inside main loop | Thomas White | |
2019-03-14 | Tweak ZMQ messages | Thomas White | |
2019-03-14 | More ZMQ/MsgPack logic fixes | Thomas White | |
2019-03-14 | Fix variable initialisation and decision about data source | Thomas White | |
2019-03-14 | Exit cleanly if connection fails | Thomas White | |
2019-03-14 | ZMQ connection and setup stuff | Thomas White | |
2019-03-07 | indexamajig: Status message improvements | Thomas White | |
1. Show the number of hits 2. Keep producing updates while the last patterns are being processed 3. Don't duplicate the code for displaying the status messages | |||
2019-03-07 | Remove old debug message | Thomas White | |
2019-01-30 | Simplify fill_queue() | Thomas White | |
2019-01-30 | Fixes for get_pattern() | Thomas White | |
2019-01-30 | Fix read_prefixed_filename() | Thomas White | |
2019-01-29 | Remove debugging message | Thomas White | |
2019-01-29 | Tidy up no_more | Thomas White | |
2019-01-29 | Improvements to get_pattern() | Thomas White | |
2019-01-29 | Add multi_event_geometry() function | Thomas White | |
2019-01-22 | Fix some small memory leaks | Thomas White | |
2019-01-03 | indexamajig: Return non-zero exit status if no patterns were processed | Thomas White | |
2018-11-15 | indexamajig: Name and shame slow processing stages | Thomas White | |
2018-11-14 | Remove unused variables | Thomas White | |
2018-11-09 | Time account fussiness | Thomas White | |
2018-07-10 | Add more filenames to cleanup list | Thomas White | |