Co-authored-by: Hans Moog <hm@mkjc.net>

*  Adds koanf support

* 

 Fix config order

Co-authored-by: jkrvivian <jkrvivian@gmail.com>

* chores: Use pkger to pack dashboards

* doc: Update dashboard README

* chores: Format the codes

* fix: Delete packr generated files

* fix: Fix 

*  Add webapi basic-auth

*  Fix wallet

*  Update docker-network

*  Add basic-auth to cli-wallet

*  Fix default value

*  Refactor client lib options

*  Address review comments

* Fix: refactored Payload to have its own package

* Fix: fixed comment

* Fix: fixed wrong comment

* Fix: reverted some changes to keep the PR as small as possible

* Refactor: refactored Data to GenericDataPayload

* Fix: fixed last refactor issues

Co-authored-by: Hans Moog <hm@mkjc.net>

*  Add support for multiple drng committees

*  Fix compilation issues

*  Fix dRNG test

*  Fix integration tests

*  Update dRNG dashboard section

*  Add default Pollen dRNG committee members

*  Add default X-Team dRNG committee members

*  Fix integration test

*  Fix error shadow declaration

*  Address review comments

*  Make Pollen and XTeam dRNG instanceID constant

*   Write rand-seed output to a file

*   Fix review comments

*  Address review comment

* refactor: Flatten webapi plugin

* fix: Remove settings for testing

* refactor: Update disabled plugins in docker-network and intergration-tests

* fix: Unexport log

* fix: Upadate the imported package in consensus integration test

* fix: Fix 

* refactor: Make endpoints as subplugins

* fix: Fix 

* refactor: Rename utils.go to common.go

* refactor: Unexported api handlers

* fix: Minor fix

* refactor: Move drng/info api to drng/

* refactor: Move spammer from webapi to core plugins

* Add clock synchronization according to proposal

* go mod tidy

* Disable clock plugin in Docker network by default

Co-authored-by: Hans Moog <hm@mkjc.net>

* Feat: updated to latest hive.go

* Docs: added docs accoding to lint error

* Refactor: renamed config variables

Co-authored-by: Hans Moog <hm@mkjc.net>

* refactor: Move messagelayer/message to tangle/

* refactor: Modify the method receiver and annotate the error messages

* refactor: Move messagelayer/payload to tangle/

* refactor: Modify the method receiver and annotate err messages in payload

* refactor: Move messagelayer/messagerequester to tangle/

* refactor: Modify the method receiver in requester

* refactor: Move messageparser/builtinfilter to tangle/

* refactor: Move messageparser/ to tangle/

* fix: Import fmt and minor fixes

* refactor: Move messagefactory/ to tangle/

* refactor: Move tipselector/ to tangle/

* refactor: Rename method receivers in tipselector

* refactor: Move messagelayer/tangle to tangle/

* refactor: Rename method receivers and annotate error messages in tangle

* refactor: Move messagelayer/test to tangle/

* fix: Update to the develop branch

* refactor: Create data payload in testing message creation

* refactor: Use tangle package in gossip

* fix: Fix 



* fix: Rename for consistency

* fix: Move message related const from payload.go to message.go

* refactor: Use single character for method receivers

* fix: Fix the unit test by using the correct variable name

* refactor: Use tangle package in spammer

* refactor: Use tangle package in faucet

* refactor: Use tangle package in networkdelay

* refactor: Use tangle package in valuetransfer

* refactor: Use tangle package in messagelayer plugin

* refactor: Use tangle package in gossip plugin

* refactor: Use tangle package in syncbeacon plugin

* refactor: Use tangle package in syncbeaconfollower plugin

* refactor: Use tangle package in webapi plugin

* refactor: Use tangle package in issuer plugin

* refactor: Use tangle package in pow plugin

* refactor: Use tangle package in metrics plugin

* refactor: Use tangle package in drng plugin

* refactor: Use tangle package in prometheus plugin

* refactor: Use tangle package in dashboard plugin

* refactor: Use tangle package in integration tests

* fix: Fix unit tests

* refactor: Remove binary/messaglayer

* Feat: merged marshal changes

* Feat: removed superfluous test

* Fix: fixed wrong comment

* refactor: Annotate error messages in marshal functions

* refactor: Import fmt package

* refactor: Aggregate all filters into filter.go

* refactor: Rename Factory to MessageFactory to clarify the functionality

* refactor: Rename Parser to MessageParser to clarify the functionality

* refactor: Rename Requester to MessageRequester to clarify the functionality

* refactor: Rename Parse to FromMarshalUtil for naming consistency

* refactor: Fix comments

* refactor: Fix comments

* fix: Use the correct function

Co-authored-by: Hans Moog <hm@mkjc.net>

* Feat: updated hive.go

* Feat: started refactoring parsing of entities

* Feat: first changes due to hive.go new marshaling logic

* Feat: fixed MessageMetadata

* Feat: fixed Approver

* Feat: updated MissingMessage

* Feat: started updating first branch models

* Feat: ported ConflictSet

* Fix: fixed bug with Conflict

* Fix: fixed some issues

* Fix: fixed branchmanager refactor

* Feat: refactored payload marshaling

* Feat: finished reworking PayloadMetadata

* Feat: finished refactoring PayloadApprover

* Fix: fixed some more models

* Feat: fixed some more issues

* Fix: one model left :P

* Fix: fixed last model

* Feat: fixed test

* Fix: fixed unused var bug due to debug

* Feat: fixed something in faucet payload

* Fix: fixed some issues

* Fix: fixed a bug in the refactor

* Feat: added debug output if error in drng test

* 

 Update drand docker image

Co-authored-by: Hans Moog <hm@mkjc.net>
Co-authored-by: capossele <angelocapossele@gmail.com>

* Feat: updated to latest hive.go

* Fix: started fixing some issued due to the refactor

* Fix: fixed some more issues

Co-authored-by: Hans Moog <hm@mkjc.net>

Split MongoDB, Grafana and Prometheus into separate docker file and load it only when specified with run command (#721)

* refactor: Rename trunk and branch to parent1 and parent2

* refactor: Minor fixes

* refactor: Update packr file

* refactor: Rename trunk/branch in tools api handlers

* Fix: Fixes the race condition when marking messages as missing

* Feat: added unit test for race condition

* Feat: upgraded hive.go

* Feat: changed missing message tracker to consider actual ids

* Feat: updated to latest hive.go

*  Fix missing map initialization

* 

 Update integration test dependencies

* Feat: updated test to be more realistic

* Feat: refactored test

* Feat: upgraded to latest hive.go

* Feat: go mod tidy

* Fix: fixed some bugs

* Feat: added debug log to tangle

* Feat: changed location of log file

* Feat: cleaned up message requester

* Feat: upgraded to latest hive.go

* Feat: updated hive

* Fix: fixed call to wrong logger method

* Feat: added logger through hive.go

* Feat: updated hive.go

* Feat: added new hive.go

* Feat: update to latest hive.go

* Fix: fix after changes in hive.go

* Feat: refactored randomMap

* Fix: fixed objectstorage leak

* Refactor: reverted changes to dbstats

* Fix: removed unused variable

* Refactor: refactored MissingMessages function

Co-authored-by: Wolfgang Welz <welzwo@gmail.com>
Co-authored-by: Hans Moog <hm@mkjc.net>
Co-authored-by: capossele <angelocapossele@gmail.com>

*  Add value tips debug API

*  Add transactionID

*  Update dRNG instance ID

*  Upgrade drand dependencies

*  Enable dRNG beacon livefeed

*  Refactor dRNG API

*  Update dRNG integration test

* Fix MPS Per Payload Graph on Grafana Dashboard

 - typo in networkdelay payload typr
 - add syncbeacon payload type

* Enable prometheus process metrics by default

* Export nodeID via prometheus

* Update Grafana with nodeID and Uptime

* Disable process metrics for peer_master in docker-network

* build cli-wallet with goreleaser

* remove cli-wallet build script

* use plain goreleaser as cgo is not required

*  Add syncbeacon to config

*  Refactor syncbeaconfollower

* Fix syncbeacon integration test

*  Fix double-spend tool

*  Fix analysis dashboard title

*  Add Shutdown method to messageRequester

*  Dirty FCOB shutdown fix

*  Add debug logs for message tangle shutdown

*  Fix typo

* 

 Fix message Tangle objects released

* Load all missing messages into message requester on startup

* Fix pointer issue for anonymous function

* Fix consensus integration test

Co-authored-by: jonastheis <mail@jonastheis.de>

* Use sync beacon follower plugin instead of sync plugin

* Remove sync and bootstrap plugin

* Refactor sync beacon stuff

* Update Docker network to use sync beacon plugins

*  Add detailed sync status to dashboard

*  Add detailed sync status to info API

*  Fix linter warning

*  Add Explorer support for sync beacon messages

* Initial integration test support for sync beacon plugins

* Fix consensus integration test

* Disable sync beacon follower plugin according to config

*  Fix dRNG integration-test

* Fix sync beacon test

* 

 Fix common integration test

* Clean up and add some comments

Co-authored-by: capossele <angelocapossele@gmail.com>

* Feat: started adding new logic to the wallet package

* Feat: intermediary commit

* Feat: added Outputs to wallet

* Feat: started implementing SendFunds

* Feat: added AddressManager + refactored code

* Feat: tx gets constructed

* Feat: txs get sent now

* Feat: fixed bug after merge

* Fix: fixed faucet

* Fix: fix double spend tool

* Fix: refactored broken tests

* Fix: fixed additional tests

* Fix: fixed some integration tests

* Fix: fixed some issues

* Fix: fixed further bugs in integration tests

* Fix: fixed some bugs

*  Make WaitToKillTimeInSeconds a parameter

*  Set default ParaWaitToKill to 60 seconds

*  Fix bug

* Feat: added an output manager

* Fix: fixed bug

* Feat: added new features to the wallet

* Feat: added missing comments

* Feat: updated some stuff

* Feat: started to implement a cli wallet

* Feat: added new features to cli wallet

* Feat: added more features to cli wallet

* Feat: MOAR FEATURES

* Feat: finished wallet

* Fix: fixed bug due to refactor

* Fix: fixed bugs

* Refactor: removed comments from private methods

* do not ignore client lib

* move wallet inside of the client dir

* do not ignore client in docker build

* go fmt yourself

* Feat: added config to wallet

* Feat: exe creates default config upon first launch

* Feat: updated gitignore

* Feat: refactored some code

* Feat: added ERROR to all "non-fatal" error messages

* Feat: removed error prefix from call and moved to func

* Feat: indented error message

* Feat: make commands look like params in useage print

* Feat: reordered commands and params

* Feat: fixed bug with colored coins creation

* Fix: fixed missing unit tests

* Feat: added message to sendfunds

* Feat: added message for faucet POW call

* Feat: intermediary commit

* Fix: Enable server-status to get server information

* Fix: Fix dependency cycle

* Fix: Fix unit test errors

* Fix: Fix integration test

* Fix: Fix consensus integration test

* Fix: fix 

* Refactor: Reorganize the wallet files to make it cleaner

* Fix: Fix 

* 

 Add script for building cli-wallet binaries

Co-authored-by: Hans Moog <hm@mkjc.net>
Co-authored-by: capossele <angelocapossele@gmail.com>
Co-authored-by: Wolfgang Welz <welzwo@gmail.com>
Co-authored-by: jkrvivian <jkrvivian@gmail.com>

* sync beacon

* add integration tests

* save point

* use beacon as anchor point

* review suggestion

* check if monitor is already running before starting

* debug: add logs

* fix tests

* separeate into sync beacon and sync beacon follower

* review fixes

* review changes

- measure number missing messages in DB at startup
- listen to events of the messagelayer tangle to determine current
  number of missing messages
- export missing message metrics through prometheus
- add missing messages chart to grafana local dashboard

*  Update double-spend tool

*  Fix linter warnings

*  Fix review comments

* Get message requester queue size

* New metric MessageRequestQueueSize

* Add Prometheus exporter for MessageRequestQueueSize

* Fix msgRequester metrics measurement

* Update local_dashboard with msgRequestQueueSize panel

* Add DBStats method to msg layer tangle

* Measure DBStats in metrics plugin, report via Prometheus

*  Add "Messages in DB" chart to local grafana dashboard

* Fix DBStats method

* Refactor DBStats metrics collection, update default params

* print DBStats() func ints

* Compare iterative and incremental DBStat data collection

* Add messageCount and solidMessageCOunt to /info webapi endpoint

* Cleanup metrics and prometheus plugin

* Update /info webapi data collection

* Fix too many relases in message tange

* Small fixes

* FIx avgSolidificationTime metrics

* Fix avgSolidificationTime calc

*  "Add Average Solidificaiton Time" Chart to Grafana Dashboard

* Restore metrics plugin parameters

*  Add synced status to node dashboard

* Make scheduledRequestsMutex a RWMutex

* Add client lib tool for past cone exist verification

* Update local_dahboard for docker-network

*  Introduce tools endpoint for webapi

 - disabled by deafult
 - contains utility api-s, e.g., "tools/pastcone" that given
   a message ID, checks if all messages in the past cone are
   present in DB down to genesis
 - Add PastConeExist() client api method

* Get rid of debug prints

* Small fixes

* 

 Update grafana dashboards

* Update client/tools.go

Co-authored-by: Jonas Theis <mail@jonastheis.de>

* PR review updates

* Remove unused variable in metrics/message

Co-authored-by: Luca Moser <moser.luca@gmail.com>
Co-authored-by: Jonas Theis <mail@jonastheis.de>

*  Add workerpools load on Prometheus

*  Fix bug

*  Change unlock order in MessageRequester StartRequest

*  Refactor gossip manager workerpools

*  Disable filter workerpools

*  Increase WorkerPools size

*  Increase docker shutdown timeout

*  Clean up code

*  Refactor

*  Remove filter shutdown

*  Increase messageRequestWorkerCount

* Add check for allowed payload size to message factory

* Fix factory usage in tests

* Add test

* Remove invalid payload size checks

* Adjust maxPacketSize in gossip and buffconn to 65KB

* Bones

* Upgrade to latest hive.go version

* Bones for the good boy!