Project

General

Profile

Task #8078

Story #8061: develop queue-based processing system for the CN

standardize task serialization for language independence

Added by Rob Nahf over 4 years ago. Updated over 4 years ago.

Status:
New
Priority:
Normal
Assignee:
Category:
d1_indexer
Target version:
-
Start date:
2017-04-24
Due date:
% Done:

0%

Milestone:
None
Product Version:
*
Story Points:
Sprint:

Description

the prototype code is using Java Serialization to turn the IndexTasks into byte[]. We should use a more universal messaging standard, like JSON, Mime Multipart, or XML.

If JSON, Java would need to determine the parsing library (Jackson seems like a decend choice).

History

#1 Updated by Rob Nahf over 4 years ago

  • Assignee changed from Dave Vieglais to Rob Nahf

#2 Updated by Rob Nahf over 4 years ago

also look at Google's protocol buffers: https://developers.google.com/protocol-buffers/docs/overview

It requires code generation of the Java class ( https://developers.google.com/protocol-buffers/docs/javatutorial )

  1. create a .proto data format definition
  2. download the protocol buffer compiler
  3. compile the .proto data format from the command line
  4. use the resulting Java class.

maybe useful? https://github.com/hopped/rabbitmq-protobuf/blob/master/src/main/resources/java/gen-java.sh

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)