*  Adds koanf support

* 

 Fix config order

Co-authored-by: jkrvivian <jkrvivian@gmail.com>

* chores: Use pkger to pack dashboards

* doc: Update dashboard README

* chores: Format the codes

* fix: Delete packr generated files

* fix: Fix 

* Upgrade dependencies

* empty

* Update packr

*  Add syncbeacon to config

*  Refactor syncbeaconfollower

* Fix syncbeacon integration test

*  Fix double-spend tool

*  Fix analysis dashboard title

*  Add Shutdown method to messageRequester

*  Dirty FCOB shutdown fix

*  Add debug logs for message tangle shutdown

*  Fix typo

* 

 Fix message Tangle objects released

* Load all missing messages into message requester on startup

* Fix pointer issue for anonymous function

* Fix consensus integration test

Co-authored-by: jonastheis <mail@jonastheis.de>

* Send networkID (AppVersion) with Autopeering Heartbeat

* Refactor Analysis Server & Dashboard

- redesign interaction between server and dashboard
- introduce networkID to organize data in server
- migrate autopeering data collection to server from dashboard

* Continue refactor

 - autopeering events triggered and called with event structs
 - refactor autopeering feed in analyis dashboard to send
   network version to frontend
 - refactor autopeering events replay

* Define networkversion for WS msg types in frontend

* Small fix in fpc_livefeed_test.go

* Autopeering Analyzer displays per network data

* Updates to Autopeering Analyzer

- Auto select which network to display when no user choice is made
- Various usability improvements
- Code formatting

* Update frontend deps

* Bugfix in analysis dashboard

* Update packr for analysis dashboard

*  Add version to FPC and metric heartbeats

* 

 Skip logging FPC and Metric heartbeats with wrong version

* Add extra checks in ParseHeartbeat

 - "old" heartbeat packets should fail parsing
 - networkID is checked for size, and format
 - added new tests

* Fix import formatting

* Fix linter warning

* Don't log empty network version heartbeat

* Update network selection visuals

* Rename Autopeering Visualizer to Pollen Visualizer

* Clenup package.json and yarn.lock

* Update packr

Co-authored-by: capossele <angelocapossele@gmail.com>

* Improved tooling for analysis and updated conflicts UI

*  Update packr

*  Run packr2

*  Refactor analysis-dashboard FPC

*  Fix linter warnings

*  Fix missing logo

* 

 Upgrade yarn dependencies

Co-authored-by: capossele <angelocapossele@gmail.com>

* Bump lodash from 4.17.15 to 4.17.19 in /plugins/dashboard/frontend

Bumps [lodash](https://github.com/lodash/lodash) from 4.17.15 to 4.17.19.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.15...4.17.19

)

Signed-off-by: dependabot[bot] <support@github.com>

* Bump lodash in /plugins/analysis/dashboard/frontend

Bumps [lodash](https://github.com/lodash/lodash) from 4.17.15 to 4.17.19.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.15...4.17.19

)

Signed-off-by: dependabot[bot] <support@github.com>

*  build packr

* 

 Update dashboard packr

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* adds default entry node

* updates default cfg values

*  Add address explorer

*  Add inclusion state as Status

*  Add conflicting and spent status

*  Fix linter warnings

*  Update packr dashboard

*  Fix missing 404

*  Replace Trunk and Branch with Parents

*  Add Available balance and solidification time

*  Update packr

*  Fix typo

* fixes typos

* lets make the dog shut up

* Feat: Integrate faucet page to SPA plugin

* Feat: Add Link to get txn of issued address

* Feat: Add faucet payload

* Feat: Add faucet plugin and minor tweaks

* Fix: Check payload type after the txn is solid

* Fix: Update package name

* Fix: Fix payload test

* Test: Add faucet test

* Refactor: Minor tweaks in plugin/faucet.go

* Feat: Add faucet webapi

* Feat: Apply faucet plugins

* Feat: Apply messagefactory and update to latest develop

* Fix: Fix import error

* Fix: Fix tests in binary/faucet

* Feat: Integrate faucet page to SPA plugin

* Feat: Add Link to get txn of issued address

* Feat: Add faucet payload

* Feat: Add faucet plugin and minor tweaks

* Fix: Check payload type after the txn is solid

* Fix: Update package name

* Fix: Fix payload test

* Test: Add faucet test

* Refactor: Minor tweaks in plugin/faucet.go

* Feat: Add faucet webapi

* Feat: Apply faucet plugins

* Feat: Apply messagefactory and update to latest develop

* Fix: Fix import error

* Fix: Fix tests in binary/faucet

* refactor: Update to latest usage

* fix: Update go.mod, go.sum

* refactor: Disable faucet plugin by default

* fix: Update to latest changes

* feat: Add faucet payload layout

* refactor: Move faucet to dapps

* feat: Enable the faucet to send funds 

* Fix: fix tests

* fix: Fix test

* fix: Initiate LedgerState

* Update packr on dashboard

* refactor: refactor SendFunds in faucet dapp

* feat: Add faucet integration test

* feat: Add faucet integration test to script

* doc: Add function descriptions

* fix: fix wrong parameter in CheckBalances

* fix: fix 

* fix some stuff

* make the faucet configurable via CLI flags

* make the faucet seed a parameter in the integration tests

* activate the faucet on the peer master in docker-network

* fixes wrong address route in faucet view

* improves faucet processing log message

* fix log messages in faucet dapp

* improve error message further

* fixes unit tests

* adds tool to auto. gen. address

* dog

* wait for faucet funding tx to get booked before processing the next request

* make the dog stay silent

* decrease pow difficulty to 1 in int. tests

* use 4 as the pow difficulty in integration tests

* 



* fix integration tests

* dec. pow diff to 1

* use 0 for the faucet integration test

* use a worker pool to serve faucet funding requests

Co-authored-by: Luca Moser <moser.luca@gmail.com>

*  Reduce solidifier worker pool capacity

*  Use GOMAXPROCS

*  Change worker count to use GOMAXPROCS

*  Set DefaultRequestWorkerCount to GOMAXPROCS

*  Fix linter warnings

*  Update hive.go

* refactor plugins

* fix fmt

* fix compile err

* fix errors

* expose singletons via sync.once

* re-disable remotelog and webauth plugins

* re-enable autopeering plugin

* Apply suggestions from code review

* Apply suggestions from code review

* add descriptive comments for getters

Co-authored-by: Luca Moser <moser.luca@gmail.com>

*  Fix grpc server race condition

*  Fix graceful shutdown

*  Add nil check

* 

 Refactor FPC gRPC server

* stop worker on server issues

Co-authored-by: Wolfgang Welz <welzwo@gmail.com>

*  Add timestamp to MongoDB

*  Update code due to code review changes.

Adds new analysis-dashboard, improves analysis server, adds proper metrics collection and Prometheus exporter (#502)

*  Clean up

*  Add TestCalculateBranchOfTransaction

*  Upgrade fpc dashboard

*  Fix docker-compose

*  Add TestMoveTransactionToBranch

*  Add TestFork

*  Add TestBookPayload

* Add test for checkPayloadSolidity

*  Add TestSetTransactionPreferred

* Add more tests

*  Fix Tangle test

* Feat: started implementing lucas test cases

* Feat: fixed some issued + further tests

* Feat: started adding invalid txs check

* Feat: added removal logic for invalid transactions

* Refactor: removed Println

*  Add test for 2nd Reattachment

* feat: Add first value transfer integration test

* fix: fix wrong plugin name

*  Add aggregated branches test cases

* Feat: added a method to generate AggregatedBranchIDs

*  Use GenerateAggregatedBranchID in test

* Feat: refactored delete logic

* Fix: fixed broken test

* Feat: added final test cases for invalid txs / payloads

* ja nei was gaht dän da ab

*  Make FPCHeartbeat smaller

*  Split vote context to fit into an FPC update

*  WIP

* Value tangle concurrency tests (#451)

* Add simple concurrency test

* Add reverse and concurrent transaction and value object solidification tests and fix bug when value object was visited more than once

* Add some documentation to make tests easily understandable

*  Add FPC analysis data persistence

*  Add Prometheus

*  Update FPC test

*  Remove linter warning

*  Remove linter warnings

*  Fix event closure

*  Add prometheus config

* WIP propagation tests but fixed already couple of bugs

* Fix: fixed some bugs

* Feat: added propagation to inclusion states to tx and its outputs

* Feat: finished the propagation down to the tx and its outputs

*  WIP

*  update docker-network entry node

*  Add .gitignore

*  Update Prometheus

*  Fix MongoDB ctx bug

* WIP propagation tests and fix bugs

*  Delete finalized conflicts

* Add colored tokens test

* Add value tangle test to github workflow

* fix: Fix wrong function name in comments

* refactor: Make testSnapshots disabled in default and minor tweaks

* Feat: fixed some issues and introduced a Debugger

* Refactor: added a few comments

* Split massive test file into slightly more digestible chunks

* Initial commit for metrics collections package

* Clean up propagation tests

* Feat: fixed bugs

* Feat: enabled missing tests

* Add some documentation and missing checks for aggregated branches

*  WIP

* Clean up tangle tests

* adds snapshot type

* Fix: finalized wasn't propagated when a branch was rejected

* Skeleton for implementation

* Measure isSynced

* UI Improvements

* Make it compile

* Measure TPS in value tangle

* implements ReadFrom and WriteTo for Snapshot

* read in snapshot file if snapshot path is defined

* renames snapshot test file

*  WIP metrics

* Measure Tips in value tangle

*  Add DBSize metric

* WIP debugging concurrency bug of death

* Measure tips in message tangle

*  Add AvgNeighborConnectionLifeTime metric

*  Bump hive.go

*  Add autopeering distance metric

* Feat: added more reliable fails in test case

* Fix: fixes a race condition in solidification

*  Add gossip network traffic metric

* Clean up test

* adds assets volume to integration test containers

* fixes some asserts

* adds non-working conflict integration test

* check transaction availability in partition

* renames integration test

* Measure MPS per payload type

* Measure (cumulative) total msg count and per payload

* Measure FPC number of currently active conflicts

* lower amount of peers

* Package updates

*  Link valuetransfer+FPC+dashboard

*  Update packr

*  Fix logo

* first passing version of consensus integration test

* remove debug printlns

* do all integration tests again

* increases avg. network delay fcob rule, removes debug printlns

* go mod tidy by Marie Kondō

* renames incl. state. conflict to conflicting

* go fmt tangle.go

* go fmt tangle_test, goimports dapp.go

* goimports again because the dog is sad

* run consensus integration test on the CI

* use explicit pumba version 0.7.2

* pray to the CI gods for the test to pass

* fix panic when tangle.Fork() is called

*  Add double spend test

*  Update hive.go

* readd all tests again

*  Add AnalysisOutboundBytes metric

*  Update go.mod

*  Start setting prometheus metrics

* reset integration framework paras

*  Update docker-compose

*  Fix typo

*  WIP

*  Update docker-compose

*  Bump golang version

*  Fix snapshot file print

*  Change client url for testing

*  Remove pflag double import

* OpinionEvent struct for calling Finalized and Failed vote events

* Measure finalized/failed conflicts + average rounds of finalization

* refactor: Remove FPC page from dashboard

* refactor: Remove Drng link from dashboard

*  Add autopeering network traffic metric

*  Bump up golang version

*  WIP

* Measure voting queries (received, unreplied) and number of opinions

*  Add sendPayload API

*  Avoid sending empty rounds

*  Add a bunch of metrics to prometheus

* Feat: outputs inherit status of transaction

*  Add Grafana integration

* Refactor: fixed erroneous rename

*  WIP

* Fix: fixed missing marshaling of output bools

* Fixes after merge

*  Fix some bugs

*  Prometheus FPC data collection

*  Small fixes

* Fix: fixed decision pending

*  Prometheus Tangle metrics data collection

*  Refactor FPC metric events

*  Bump up hive.go

*  Add metric heartbeat packet

*  Add clients metrics collection via the analysis server

*  WIP

* Prometheus clients info

* Fix metrics config + enable prometheus collection on entry_node

* use new protocol

* wip: redial on lost connection

* assure conn is not nil

* close on write

* Fix bugs + enable spammer on peer_master

* Fix analysis fpc livefeed bug

* connector cleanup

*  Autopeering NeighborCount + Network Diameter metrics

* do not log the dial error since the logger might not available

* removes test snapshot plugin

*  Improve analysis-server

*  Change log to debug level

* graph pkg from autopeering-sim

* Remove debug line + hive.go update

*  Change hive.go version

* get rid of test snapshot plugin

* fixes wrong use of Println

* removes random tool

*  Move conn initialization

* removes duplicated value entry in GH CI workflows

*  Update hive.go

*  Clean go.mod

*  Fix graph pkg linter warnings

*  improve analysis plugin

*  Fix metrics plugin linter warning

* xxx

* wip

* fixes integration test

*  Add FPC global metrics to prometheus

*  Fix double register

*  Fix client pkg linter warning

*  Fix webapi linter warnings

*  Run you fools!

*  Fix testutil import

* Adjust inbox worker pool capacity to default

* Adjust inbox worker pool capacity to default (#505)

*  Address PR review comments

*  Fix watch dog warnings

*  Let's try with a new bone for the dog now..

* upgrade hive.go to master

*  Fix local dashboard

*  Improves mongoDB reliabilty

*  Fix linter warnings

*  Fix test

*  Make dbSize a prometheus Gauge

* 

 Remove unecessary initialization

* introduce worker pool for storing finalized vote ctxs

* Update packr

* type alias FPCRecords to []FPCRecord

Co-authored-by: jonastheis <mail@jonastheis.de>
Co-authored-by: Hans Moog <hm@mkjc.net>
Co-authored-by: jkrvivian <jkrvivian@gmail.com>
Co-authored-by: Luca Moser <moser.luca@gmail.com>
Co-authored-by: Levente Pap <levente.pap@iota.org>
Co-authored-by: Martyn Janes <martyn@obany.com>
Co-authored-by: Wolfgang Welz <welzwo@gmail.com>

* Update Autopeering Visualizer

 * Display online nodes in Wordcloud
 * Refactor NodeView layout
 * Display only shortened nodeID-s (first 8 chars)

* Refactor

* Frontend updates, remove wordcloud

 * wordcloud consumes too much resources, removed for smooth
   graph updates.
 * Add more colors to NodeView

* Update packr2

* Bump websocket-extensions in /plugins/analysis/dashboard/frontend

Bumps [websocket-extensions](https://github.com/faye/websocket-extensions-node) from 0.1.3 to 0.1.4.
- [Release notes](https://github.com/faye/websocket-extensions-node/releases)
- [Changelog](https://github.com/faye/websocket-extensions-node/blob/master/CHANGELOG.md)
- [Commits](https://github.com/faye/websocket-extensions-node/compare/0.1.3...0.1.4

)

Signed-off-by: dependabot[bot] <support@github.com>

* Bump websocket-extensions in /plugins/analysis/dashboard/frontend

Bumps [websocket-extensions](https://github.com/faye/websocket-extensions-node) from 0.1.3 to 0.1.4.
- [Release notes](https://github.com/faye/websocket-extensions-node/releases)
- [Changelog](https://github.com/faye/websocket-extensions-node/blob/master/CHANGELOG.md)
- [Commits](https://github.com/faye/websocket-extensions-node/compare/0.1.3...0.1.4

)

Signed-off-by: dependabot[bot] <support@github.com>

* 

 Update packr

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: capossele <angelocapossele@gmail.com>

*  Add panic if backgroundWorker fails

*  Use log.Panicf instead of panic

* Transition to Analysis Dashboard for visualization

 * Add FPC heartbeat changes to analysis plugin
 * Introduce Dashboard for analysis related visualization
 * Refactor Analysis Dashboard backend
 * Prepare base of frontend
 * Add skeleton of AutopeeringStore in frontend

* Update analysis dashboard frontend dependencies

* Remove old analysis webinterface

* Remove unnecessary components from analysis dashboard

* Remove analysis webinterface from pluginmgr

* Analysis Dashboard Frontend updates for autopeering

* Use base58 encoding for autopeering node ID visualization

* Add Ping WS message to analysis dashboard

* Frontend visuals update

* AutopeeringStore updates
 * Graph mouse hover highlighting
 * Fill graph with data upon rendering
 * Dynamic node spacing in graph based on number of nodes
 * Added code comments for readability

* packr config updates

* Websocket connection lost warning in frontend

* Update title of index.html

* packr update for analysis dashboard

* Update frontend README

* Update default config: webinterface -> dashboard

* Fix linter warnings

* Delete package-lock.json

* Frontend updates
 * Size of vertices enlarges during selection
 * Decrease visibility of not highlighted links
 * Fixed layout for react components with auto overflow (no jumping)

* Disable Analysis-Dashboard plugin by default

* Adjust docker container configs for analysis dashboard

Co-authored-by: Angelo Capossele <angelocapossele@gmail.com>

* Refactor heartbeat packet into message for TLV

* Refactor Analysis-Server for TLV protocol

* Adjust Heartbeat packet tests for TLV

* Remove obsolete ping packet

* Add comments

* Add message registry for analysis packet types

* Update hive.go

* Refactor analysis message registry initialization

* go mod tidy for integration tests

* format files with gofmt

* Linter warning fix

* Small fix

* normalize bind addresses prints

* refactors analysis plugins

* adds tests for parsing/serializing heartbeat packets

* adds additional test case

* normalize usage of word 'ids'

* updates packr files

* normalizes handler routes for static assets for the analysis web interface

* normalize config key names

* adjusts configs for new analysis config keys

* fixes review comments

* adapt to hive.go autopeering events changes

* add exposed function to start autopeering neighbor selection

* start autopeering neighbor selection when gossip is started

* update go modules

* Apply suggestions from code review

Co-Authored-By: Angelo Capossele <angelocapossele@gmail.com>

* fix build errors

Co-authored-by: Angelo Capossele <angelocapossele@gmail.com>

* normalize global plugin vars

* throw the dog a bone

* remove unused logger in drng web api endpoint

* Update analysis/client with Heartbeat message type

* Refactor analysis/server for heartbeat messages

* Bug fix in analysis server

* Fix heartbeat packet marshaling

* Fix `nodes` and `links` maps handling

* Fix in cleanup in recordedevents

* Fix typos

* Fix event log and heartbeat handling

* Refactor analysis server

 * Remove obsolete packet types
 * Run Analysis Server Record Manager in background
 * Refactor Analysis Client with ticker

* Define max amount of neighbors to report

* Small fixes

* New visualization for analysis server

* PR review fixes

* Remove `nodeOnline` and `nodeOffline` events from analysis server

* Refactor analysis frontend

* Fix bug in websocket, remove obsolete triggers

* Remove debug vars, re-enable websocket ping

* Stop ws pings when closed

* Color settings for visualizer

* Update graph colors

* Fix no neighbor bug

* Dynamically change springLength based on nodes

* Small color fix

* Rename ShutdownPriorityAnalysis

* Formatting, linter suggestions

* Update packr file for visualizer

* Websocket Write() instead of TryWrite()

* Add docker compose for running integration tests.
Runs entry_node and arbitrary number of peers in docker network

* Fix permission denied in container if run without mounting a `rw` volume making it possible to run as throw-away container.
Remove `VOLUME` from Dockerfile as this only pollutes host system with anonymous volumes.

* Use named network for easier external use

* Add test container that discovers peers and waits for autopeering to happen

* Fix min waitForNeighbors

* Add go.sum

* Run integration tests with Github Actions

* Added framework that abstracts the docker network and provides convenience functionality

* Update directory in Github Actions

* Add bash script for automated local test execution

* Add getMessageByHash endpoint

* Adjust to merge changes

* Add methods to easily do HTTP POST requests

* Added relay message test

* Increase client timeout

* Verbose output for tests makes it easier to follow the execution

* Introduce small API wrapper for GoShimmer HTTP API

* Adjust relay test to use new API wrapper

* WIP: Docker logs

* Fix issue with serving visualizer analysis server of entry node

* Persist logs of containers after CI run

* Fix test file

* Fix uploading of artifacts

* Save all containers' logs as artifacts

* Create logs files also with local run

* Add possibility to retrieve logs from a peer via Docker logs

* Make tester part of the goshimmer module to make code sharing possible

* Use client/lib to make HTTP requests in tester

* Fix unit test directory

* Add comments/doc to the code

* Add readme

* Move tester to own module and don't build container but use existing golang one instead

* Address PR comments

* Adjust to merge

* Only use 1 config file for all containers

* go mod tidy

* Rename client lib base url