New data flow (#944)

* feat: Extract stores from tangle to MessageStore (#900)

* feat: Extract stores from tangle to MessageStore

*  Change FPC shutdown priority

* chores: Update wording

* fix: Store MessageMetadata automatically

* feat: Introduce booked flag to MessageMetadata

* feat: Introduce MessageBooked event

* Fix: Fix 



Co-authored-by: capossele <angelocapossele@gmail.com>

* refactor: Refactor solidifier (#923)

* feat: Add parents check and introduce eligible flag to MessageMetadata

* feat: Hook events to parents check

* feat: Add MessageEligible event

* refactor: Update to the data flow figure and remove the solidifier workerpool

* test: Add InvalidParentsAgeMessage unit test

* fix: Fix 

* fix: Fix comments

* test: Implement data flow unit test - from filter to solidifier

*  Add inbox workerpool to FilterStoreSolidify unit test

* test: Use WP at start and use default parameters in unit test

*  Enable Leak detection for debugging

*  Fix FPC round duration

*  Disable Leak detection

*  Assign shutdown order to value tangle

*  Dump stacktrace in case of shutdown failure

* Release msg and metadata if findByID fails

* Ensure to set right issuanceTime in messageFactory

*  Fix transaction could not be booked in time issue

* 

 Fix linter warnings

* chores: Remove debugging codes

* Revert "chores: Remove debugging codes"

This reverts commit b35ec269a762583b2a06e5a3235c80bf61945ed3.

Co-authored-by: capossele <angelocapossele@gmail.com>

* Add core logic for timestamp voting (#930)

*  Add timestampOpinion

*  Add TimestampQuality unit test

*  Remove debug print

*  Simplify code

* feat: Add parents check and introduce eligible flag to MessageMetadata

* feat: Hook events to parents check

* feat: Add MessageEligible event

* refactor: Update to the data flow figure and remove the solidifier workerpool

* test: Add InvalidParentsAgeMessage unit test

* fix: Fix 

* fix: Fix comments

* test: Implement data flow unit test - from filter to solidifier

*  Add inbox workerpool to FilterStoreSolidify unit test

* test: Use WP at start and use default parameters in unit test

*  Enable Leak detection for debugging

*  Fix FPC round duration

*  Disable Leak detection

*  Assign shutdown order to value tangle

*  Dump stacktrace in case of shutdown failure

* Release msg and metadata if findByID fails

* Ensure to set right issuanceTime in messageFactory

*  Fix transaction could not be booked in time issue

*  Fix linter warnings

*  WIP

*  Fix messagemetadata

*  Add missing comment

*  Fix MessageMetadataFromMarshalUtil

*  Address review comments

* 

 Refactor err usage

Co-authored-by: jkrvivian <jkrvivian@gmail.com>

* test: Add invalid timestamp msgs to data flow unit test (#935)

* test: Add invalid ts msgs to data flow unit test

* fix: Unexport testing methods

* fix: Fix unit test

*  Refactor filter setup (#937)

* feat: Introduce invalid to MessageMetadata (#938)

* feat: Hook DeleteMessage to MessageInvalid event

* feat: Introduce invalid flage to MessageMetadata

* fix: Fix comments

* refactor: Remove double locking in boolean setters

* fix: Fix typo

* refactor: Apply defer to unlock mutexes

* feat: Avoid gossiping requested messages (#941)

* feat: Avoid gossiping requested messages

* chores: Format with gofmt

* refactor: Make requestedMsgs a structure

* fix: Fix 



* Fix sigsev in faucet

* Get rid of ugly read/write lock business

Co-authored-by: Ching-Hua (Vivian) Lin <jkrvivian@gmail.com>
Co-authored-by: Levente Pap <levente.pap@iota.org>
Co-authored-by: jonastheis <mail@jonastheis.de>