1
0
mirror of https://github.com/netdata/netdata.git synced 2021-06-06 23:03:21 +03:00

95 Commits

Author SHA1 Message Date
Austin S. Hemmelgarn
9574cb4c95 Bundle the react dashboard code into the agent repo directly. (#11139)
* Remove code for bundling the dashoard on install.

* Bundle the dashboard code directly into the agent repo.

This diffstat looks huge, but it’s actually relatively simple. The only
_actual_ changes are in the Makefiles, `configure.ac`, and the addition of
`generate_dashboard_makefile.py`. Everything else consists of removing
files that are included in the dashboard tarball, and extracting the
contents of the tarball into `web/gui/dashboard`.

* CI cleanup.

* Automate bundling of the dashboard code.

This replaces the makefile generator script with one that handles
bundling of the dashboard code in it’s entirety, and updates the GHA
workflow used for generating dashboard PRs to use that instead of the
existing shell commands.

It also removes the packaging/dashboard.* files, as they are no longer
needed.
2021-05-14 11:41:16 -04:00
Timotej S
a65193925e Move ACLK Legacy into a subfolder (#10265)
* move all legacy ACLK into a subfolder to make space for ACLK-NG
2021-01-19 09:41:35 +01:00
Vladimir Kobal
943ee2482b Add HTTP and HTTPS support to the simple exporting connector (#9911) 2020-11-05 19:08:17 +02:00
Austin S. Hemmelgarn
b8713d153d Add a few changes that were missed by the systemd updater support. (#10007)
* Add a check to ensure that the install leaves a clean repo.

* Add a few changes that were missed by the systemd updater support.
2020-09-30 17:32:40 +10:00
Timotej S
718d8872cb add missing file to gitignore (#9946) 2020-09-18 13:23:20 +10:00
thiagoftsm
664d180dc7 Fix potential memory leak in ebpf.plugin (#9484)
Fix reported bugs with ebpf.plugin.
2020-07-14 16:42:45 +00:00
thiagoftsm
18ec989b21 Rename eBPF collector (#8822)
We renamed eBPF collector for a more meaningful name.
2020-05-13 16:56:42 +00:00
Vladimir Kobal
93ee07fd4c Add netdata.service.* to .gitignore (#8556) 2020-04-03 13:28:14 +03:00
Austin S. Hemmelgarn
cf948d42c2 Switched to the new React dashboard code as the default dashboard. (#8363)
* Initial installer components for new dashboard.

* Add script to switch between react and classic dashboards.

* Update to newest version of react dashboard.

* Properly substitute webdir.

* Fix installation of dashboard switch script.

* Properly handle file ownership and permissions.

* Fix install of react dashboard.

* Add dashboard_info.js to the react dashboard tree.

* Update to version 0.3.2 of the React dashboard.

* Switch using file lists instead of nuking old directory.

* Properly handle updates.

* Fix variable naming in switching script.

* Fix copying of files in switching script.

* Fix switching script invocation in installer.

* update dashboard to v0.4.0

* v0.4.1

gauge & easypiechart width update
proper centering when clicking alarm in alarms-log
keep loader until react app is ready
fix top bar not showing when highlighting (few lines of code)
"check known URLs" issue
"reset" options is not hooked up
go to host node from streamed node (low priority, because that's removed on release)

* Persist user selection of dashboard across updates.

* update dashboard to v0.4.2 (temperature, units options fixed)

* v0.4.5
fixed print modal progress text
force reload on sync-selection option change

* fix memory leak on firefox

* fix active-alarms number in main.js header
fix "back to normal" notifications constantly throwing in loop

* fix active-alarms fetching

* support subpaths

Co-authored-by: Jacek Kolasa <jacek.kolasa@gmail.com>
2020-03-31 06:53:48 -04:00
Timo
eac0dce5e5 Adds install-fake-charts.d.sh to gitignore (#8502) 2020-03-26 18:07:23 +01:00
thiagoftsm
696264006c eBPF process plugin (#7979)
* syscall_plugin: Compilation

This commit brings the necessaries changes to the compilation files

* syscall_plugin: Collector body

This commit brings the collector body to files.

* syscall_plugin: .gitignore

This commit adds syscall.plugin to .gitignore

* syscall_plugin: Plugin adjust

Fix reference and remove message

* syscall_plugin: Remove limit

Remove call to setrlimit

* syscall: Fix start

This commit fixes problems related with start of the plugin

* syscall_plugin: Bring heartbeat

This commit removes the sleep and changes to heartbeat to avoid plugin receive a SIGTERM

* syscall_plugin: Missing semicolon

* syscall_plugin: Fix dimension

Brings the initial value of chart for the normal dimension of the other values

* syscall_plugin: Fix dimension 2

The previous change did not give the expected results, so I am bringing more a fix

* syscall_plugin: adjust values

Rename function and adjust pid size

* syscall_plugin: Remove Chart and fix var

this commit removes a chart that will not be created and fix an error
when the bytes were calculated

* syscall_plugin: Brings error

This commit brings a new variable that will be used to identify errors

* syscall_plugin: Rename charts

This commit starts to rename the charts properly

* syscall_plugin: Rename plugin

* syscall_plugin: missing changes for rename

* syscall_plugin: fix compilation

* syscall_plugin: bring new charts

* syscall_plugin: Warnings

Remove warnings from compilation time

* vfs_plugin: Fix Error chart plot

There was an error when the chart was being displayed

* vfs_plugin: Change family

This commit changes the family of the VFS plugin

* vfs_plugin: Fix order

This PR fixes the wrong order when creating a chart

* vfs_plugin: Remove path

Remove path from structure

* vfs_plugin: From Perf to HASH

This commit converts the main source a hash table and also split the data collection per chart

* vfs_plugin: Adjusts and exit

This commit brings adjusts to the collect and the complete monitor to exit events

* vfs_plugin: Start process

This commit brings the monitoring of a process start and thread creation to Netdata

* vfs_plugin: Visualization and collection

Adjust variables to show and to collect data

* vfs_plugin: Connection with apps plugin

This commit starts to bring the connection with apps.

* vfs_plugin: Various

This commit brings new label for charts, fix to error chart and adjusts for new charts, I am sorry

* vfs_plugin: basis new chart

This commit brings the basis of the new charts for the plugin

* vfs_plugin: Apps plugin

This commit brings the integration with apps.plugin

* vfs_plugin:fix counter

This commit fixer the difference between apps plugin and counter

* ebpf_plugin: rename charts

This commit renames the charts

* ebpf_plugin: New charts adjusts and log start

* ebpf_plugin: Log thread

Creates the log thread that will be used to store error message

* ebpf_plugin: Rename Web Group

This commit reorganize the charts on dashboard

* ebpf_plugin: Restore

This commit restore the previous status of the collector where we only have a global vision of the problems

* ebpf_plugin: kretprobe

This commit brings the initial changes for the collector works with both eBPF program

* ebpf_plugin: New syscalls

This commit brings the new syscalls that we are monitoring

* ebpf_plugin: New charts

This commit brings new charts to the collector

* ebpf_plugin: Parse config

This commit starts the parser of the file

* ebpf_plugin: collector debug

* ebpf_plugin: Global variables from config

This commit brings the global variable update from the config file

* ebpf_plugin: Clean kprobe_events

This commit brings the clean of kprobe_events and also starts the common library for all eBPF collectors

* ebpf_plugin: Check kernel version

This function brings a check for the kernel version

* ebpf_plugin: Start documentation

This commit brings the initial documentation for the users

* ebpf_plugin: Documentation

This commit brings adjust to code and updates for the documentation

* ebpf_plugin: this commit brings the developer mode to the collector

* ebpf_plugin: Documentation

This commit brings more information to the documentation

* ebpf_plugin: Documentation

This commit brings more information to the documentation

* ebpf_plugin: errno to logs

Brings errno number to logs

* ebpf_plugin: Documentation

This commit brings fixes to the collector documentation

* ebpf_plugin: Move description

This commit move the chart description from the C code to dashboard_info.js

* ebpf_plugin: Rename files

This commit rename files to the final version

* ebpf_plugin: COntinue renaming

This commit continue renaming the files to the final version

* ebpf_plugin: Renaming process

This commit renames the final plugin

* ebpf_plugin: Finish rename

This commit finishes the rename processing

* ebpf_plugin: fix entry charts

This commit removes one chart from  mode

* ebpf_plugin: Fix remove

This commit brings a new function to fix the unload of collector when the collector
is running in entry mode

* ebpf_plugin: Rename on old kernels

This commit brings fixes for syscall names

* ebpf_plugin: Timestamp to log

This commit brings the timestamp to the logs

* ebpf_plugin: Remove syscall

With the changes on the backend, we are not monitoring more sys_clone

* ebpf_plugin: The syscall is important for 5.3 or newer, so I am returning

* ebpf_plugin: Remove concurrency

This commit adds variables necessary to interact with the new structor
of the eBPF program

* ebpf_plugin: Ids to dimension

This commit fews the functions name as ids for the dimensions

* ebpf_plugin: Missing chart

This commit brings the missing chart for Netdata

* ebpf_plugin: Remove unecessary message

Remove unecessary error message from the collector

* ebpf_plugin: Rename dimension

This commit renames the dimension for something more meaninful

* ebpf_plugin: Optional log

This commit converts the developer.log in an optional feature

* redirect to stdoou

This commit starts to bring the capability to redirect everything to stdout

* ebpf_plugin: Disable dev mode

This commit removes the possibility to load the dev mode file for while

* ebpf_plugin: Disable eBPF process

By default this plugin won't be enabled

* ebpf_plugin: Update debug message

* ebpf_plugin: this commit adjusts documentation to next release.

* ebpf_plugin: documentation fix.

* ebpf_plugin: Percpu hash

This commit moves from an unique hash table for various to speed up
the collector

* ebpf_plugin: Compatibility

This commit set compatibility version between kernels
2020-02-17 21:28:33 +00:00
Austin S. Hemmelgarn
8f7d83c00b Make temporary directories relative to $TEMPDIR. (#8066)
* Make temporary directories relative to $TEMPDIR.

* Add externaldeps to .gitignore.
2020-02-12 10:23:31 -05:00
Markos Fountoulakis
ce9f70d7b3 Agent claiming (#7525)
Initial infrastructure support for agent claiming.

This feature is not currently enabled as we are still finalizing the details of the cloud infrastructure w.r.t. agent claiming. The feature will be enabled when we are ready
to release it.
2019-12-19 10:01:59 +01:00
Andrew Moss
c8c72f18a6 Labels issues (#7515)
Initial work on host labels from the dedicated branch. Includes work for issues #7096, #7400, #7411, #7369, #7410, #7458, #7459, #7412 and #7408 by @vlvkobal, @thiagoftsm, @cakrit and @amoss.
2019-12-16 15:12:00 +01:00
Joel Hans
0f72fd0290 Add generator dirs to gitignore (#7421) 2019-12-05 20:58:47 -08:00
Markos Fountoulakis
16f835489c Implement netdata command server and cli tool (#7325)
* Checkpoint commit (POC)

* Implemented command server in the daemon

* Add netdatacli implementation

* Added prints in command server setup functions

* Make libuv version 1 a hard dependency for the agent

* Additional documentation

* Improved accuracy of names and documentation

* Fixed documentation

* Fixed buffer overflow

* Added support for exit status in cli. Added prefixes for exit code, stdout and stderr. Fixed parsers.

* Fix compilation errors

* Fix compile errors

* Fix compile errors

* Fix compile error

* Fix linker error for muslc
2019-12-04 14:21:22 -08:00
Vladimir Kobal
16d40fbb14 Add CMocka unit tests (#6985)
* Add str2ld test

* Build test with Autotools

* Add storage_number test

* Configure tests in CMake
2019-10-15 15:15:40 +03:00
thiagoftsm
e3471fa572 Create a template for all dimensions (#6560)
* health_connection: Comments inside Health Config

To try to understand better what is necessary to change and where it is necessary
to change anything inside the health, I commented the functions inside this file"
"

* health_connection: Comments about Health in other files

This commit brings the rest of the comments that were missed for health"

* health_connection: Comments on health_log

I had to append more comments on health_log

* health_connection: Create a new variable

New variable is created to work with foreach

* health_connection:  Fix new option and doc

The first implementation of the 'foreach' had a problem, this fixes the error.
This commit also brings the updates for the documentation

* health_connection:  Understanding health

This commit is to save the place that I am working, it has the map to understand all the alam process

* health_connection:  Update map

I changed the position of the error message to identify the correct place to add new alarms

* health_connection: End of simple alarm

This commit finishes what is necessary to bring the same lookup for different dimensions  in one unique line

* health_connection:  Documentation and template steps

This commit brings the documentation missed for template and comments to help in the next
step of apply a template to create an alarm.

* health_connection: Restoring

After some tests, it was detected that the alarms were not working as expected

* health_connection: Fix bug and bring dimension to template

This commit brings a fix for an old Netdata bug, before this the Netdata always tried to create
a new entry in an index with the same id raising an error.
It also brings the possibility to use 'foreach' in  template

* health_connection: Fix cmake compilation

There was a problem with cmake compilation fixed by this commit

* health_connection: shell script

Finilize the shell script to test the PR

* health_connection: Remove debug message

During the development, I used some messages to understand the code
this commit removes the last message

* health_connection: Fix bugs

This commits fix bugs reported by tests

* health_connection: Alarm working

This commit brings the necessary change for the alarms work, but it is missing the unlink from the newest list

* health_connection: Template code written

This commit finishes the creation of alarm from template, but it was not tested yet.

* health_connection: Remove comments

I am removing the comments from this PR to bring back late

* health_connection: Remove lines

Another commit to restore the files before they to be commented

* health_connection: New alarm and remove messages

I am bringing a new alarm to test template with SP and removing comments used during the development

* health_connection: Functional test review

After to review the functional test script, it was necessary to small adjust to
test all the features available with the new version

* health_connection: Free structure

I am moving the free list for the correct place, the previous place was not safe

* health_connection: ShellCheck

This commit fixes the problems with shellcheck

* health_connection: FIx hash

This commit fix the hash calculation that was using wrong input

* health_connection: Fix message error

The system was showing a wronge message, because when we have foreach
the alarm created with templated is added in a second stage to the index

* health_connection: Fix documentation

In this commit I am fixing the grammar of the previous doc and bringing
two examples

* health_connection: Fix examples

This commit fix the last two examples that was brought in this PR

* health_connection: Fix example doc

When I brought the correct grammar in the last commit, I lost a mark

* health_connection: Grammar fix

Fixing grammar of the documentation

* health_connection: Memory leak

This commit fixes the memory leak that was present in the PR

* health_connection: Reload

This commit fix the problem that the alarms were not linked after
to receive a SIGUSR2

* health_connection: False Positive from codacy

Codacy was given a false positive, I changed the function to avoid it.

* health_connection: dead code

Remove dead code from the code.

* health_connection: Memory Leak

Remove memory leak when clean simple pattern

* health_connection: Script format

With this commit I am formatting the last message to return
for the default color on terminal

* health_connection: Script format 2

With this commit I am formatting the last message to return
for the default color on terminal

* health_connection: Script format 3

With this commit I am formatting the error message to return
for the default color on terminal
2019-09-27 14:24:54 +02:00
Adrien Mahieux
0942680f85 Collector slabinfo (#6800)
### Summary

Provide new collector parsing `/proc/slabinfo` to provide details on kernel slab structures.

Asked by issue #13 (very happy for the oldest issue in backlog) 

##### Component Name

collectors/slabinfo.plugin

##### Additional Information

This slabinfo details allows to have clues on actions done on your system.
In the following screenshot, you can clearly see a `find` done on a ext4 filesystem (the number of `ext4_inode_cache` & `dentry` are rising fast), and a few seconds later, an admin issued a `echo 3 > /proc/sys/vm/drop_cached` as their count dropped.
2019-09-18 14:13:32 +02:00
thiagoftsm
0798426c7d Fix clear notification missing (#6638)
* alarm_clear: Mapping

In this PR I mapped all the necessary steps to discover the solution for the ISSUE 6581

* alarm_clear: Documentation and fixes

This commit fixes the problem that were present in Netdata and it also updates
the documentation of the functions and Netdata.

* alarm_clear: shell script

The original implementation did not have a shell script, here I begin to fix this

* alarm_clear: shell script

It is necessay to verify why make is not producing the same binary than cmake and finish the changes in the script

* alarm_clear: adjust in health.c

I rewrote the health.c to be more readable, but I discovered the problem I had in the last few hours
were due kernel update

* alarm_clear: script changes

In this commit I am bringing the final version of the script that
test the alarm repetition

* alarm_clear: script fix and remove comments

IN this commit I am fixing the shellcheck errors and removing some debug messages
that were present in the code while I was developing

* alarm_clear: Format

The health.c had wrong tabulation, this PR brings back the pattern of space as tab for this file

* alarm_clear: Script

The script was using killlall that is not more present in all Linux distribution
this commit removes this and bring the new way to stop Netdata

* alarm_clear: return to previous tabulation

I am bringing back the old tabulation here and I will create a new PR
exclusively for this

* alarm_clear: Remove comments

I am removing comments from this PR to keep the focus in the major problem

* alarm_clear: Remove comments 2

I forgot one comment

* alarm_clear: New variable

I am appending a new variable in the check before the rebase, because the health.c changed in other file
has a direct relationship with what I did here until now

* alarm_clear: Fix clear repetition

With this last commit, I am bringing a new way to raise the clear alarm, but it is not repeating more
with this fix, it displayed one time when it is cleaned and it will display the message again, if and only if,
the alarm was raised.
2019-09-03 18:30:26 +00:00
Costa Tsaousis
fd9eb73ccc make coverity-scan.sh usable by hand (#6747)
* make coverity-scan.sh usable by hand

* updated debug variable and docs

* merge coverity-scan.sh and coverity-install.sh

-- MERGING AND TAKING OVER FURTHER IMPROVEMENTS as agreed --
2019-08-31 21:10:53 +03:00
Katharina Drexel
fbce1ab707 exact path to netdata.conf in .gitignore (#6709)
* exact path to netdata.conf in .gitignore

Signed-off-by: Katharina Drexel <katharina.drexel@bfh.ch>

* Remove netdata.conf from .gitignore

After discussing with the team, we come to realise this is no longer needed.
In the far past, netdata had its configuration at the root of the repo and thus the .gitignore entry.

Removing
2019-08-28 17:36:58 +03:00
thiagoftsm
2f7962c9e1 Fix parsing SSL ACL along with others (#6468)
* sslstream: ACL parser

It was noticed in the issue 6457 that the some ACLs were not parsing
correctly when they were along SSL acl, this commit fixes this'

* sslstream: remove comments

This commit removes the comments that were present while I was testing the code

* sslstream: Tests

This commit adds ACL tests to check the Netdata response to them

* sslstream: Tests

Fix the extension to upload the files

* sslstream: more tests

In this commit I am bringing more tests, including the ssl tests'

* sslstream: leading space

Remove leading space from variable that was creating problem with shellcheck

* sslstream: glob

Remove special character from script

* sslstream: Makefile

The Makefile diretives were pointed to wrong files

* sslstream: Missing stream encrypt

This commit solves the problem of the stream not be encrypted, but
it is not the final solution, because the parser made is incomplete.

* sslstream: Finish encrypt channel

This commit brings the step that I was missing, the complete encryptation
in the communication between Master and Slave

* sslstream: Fix argument in script

After the latest tests, it was verified that two arguments given to a function
inside the script were not correct, with this PR I am fixing this!

* sslstream: Fix argument in info

Instead to call a function to deliver an integer I was passing a size_t value.
Only cmake showed this, but not in my clion! :/

* sslstream: Fix redirect

When we were having different SSL configuration, the system were not applying
the option for all

* sslstream: Update documentation

Our documentation was not clear about the rules according our code
so I am updating the text to explain for the users

* sslstream: Adjust script

With this last commit, I am adjusting the tests to avoid false positive

* sslstream: Missing elif

The previous commit had a missing elif in the shell script

* sslstream: Split ports

Before this commit Netdata was having SSL as a global option, now it has as a real ACL.

* sslstream: reduce context

The stream variable will not be affected in the master side, it is only necessary
on the slave side, so I am reducing the context of it

* sslstream: Force SSL

When the user has certificate and he does not set any SSL flag, it is necessary
to append the SSL=force flag

* sslstream: Default flag

It is necessary to have a default flag when the SSL flags are not SET

* sslstream: remove comments

Remove comments from the scrip

* sslstream: moving flag

It is better the flag to be set inside socket instead everytime there is a new connection

* sslstream: documentation

Fix a sentence in the web/server/README.md
2019-07-25 18:43:04 +02:00
thiagoftsm
3076cfe5d4 Url parser refactoring (#6247)
* URL_parser_review comments 1

* URL_parser_review restoring web_client.c

* URL_parser_review restoring url.h

* URL_parser_review restoring web_client.h

* URL_parser_review restoring inlined.h

* URL_parser_review restoring various

* URL_parser_review commenting!

* URL_parser_review last checks!

* URL_parser_review registry!

* URL_parser_review codacy errors!

* URL_parser_review codacy errors 2!

* URL_parser_review end of request!

* URL_parser_review

* URL_parser_review format fix

* URL_parser_review restoring

* URL_parser_review stopped at 5!

* URL_parser_review formatting!

* URL_parser_review:

Started the map of the query string when it is necessary

* URL_parser_review:

With these adjusts in the URL library we are now able to parser all the escape characters!

* URL_parser_review: code review

Fixes problems and format asked by coworkers!

* URL_parser_review: adjust script

The script was not 100% according the shellcheck specifications, no less important
it was a direct script instead a .in file

* sslstream: Rebase 2

It was necessary to change a function due the UTF-8

* sslstream: Fixing 6426

We had a cast error introduced by other PR, so I am fixing here

* URL_parser_review

Change .gitignore to avoid considering a script file.
2019-07-25 12:30:00 +00:00
Paul Emm. Katsoulakis
079d71d6fb netdata/packaging: Binary distributions - clean up .DEB package generation process (#6465)
* netdata/packaging: [ci skip] reinstate dev branch to help testing

* netdata/packaging: [ci skip] Yes, make the right package choice on json-c for debian based distros..

* netdata/packaging: [ci skip] two more packages that differentiate on debian/ubuntu...............

* netdata/packaging: [ci skip] Add more package dependencies around building

* netdata/packaging: [ci skip] Introduce changelog generation technique for .DEB

1) Remove contrib/debian/changelog from gitignore, we want it in
2) Add variables to monitor latest release version and latest release date from git
3) Add a templated contrib/debian/changelog, that will be the starting point for our changelog generation.
   Either on stable release or nightly releases, we will be generating the logs since the previous release, to manage the content.
   Note: We might eventually take the effort to produce one large changelog and append each time the extra stuff
4) Add the steps to prepare the source and the changelog for building and execute the build

At this stage things should still be broken, but we should have come closer to a ready-to-build-the-package environment per distro

* netdata/packaging: [ci skip] Extract to specified directory, otherwise we dump it on a privileged folder using an unprivileged user (builder)

Also, a fix on sed command, missed the s keyword on the string
replacement

* netdata/packaging: [ci skip] Should be in-place replacement, use -i instead of -e

* netdata/packaging: [ci skip] wrong parameter usage

* netdata/packaging: [ci skip] factor out the two build commands to run as a single bundle. refactor trigger deb build script respectively

* netdata/packaging: [ci skip] Be sure to copy over the build script to the build path

* netdata/packaging: [ci skip] OCD - unnecessary s added

* netdata/packaging: [ci skip] Changelog generation should take place on the repo side, then copy it over to the destination (If that doesnt work well, will just provide a static link for changelog

* netdata/packaging: [ci skip] missed the ignore branch option
	Also, a nit on the gbp command

* netdata/packaging: [ci skip] link to the original path, then create symlink on build folder
                             Also, fix --since option

* netdata/packaging: [ci skip] Run replacement of changelog fields on the host, not on the container

* netdata/packaging: [ci skip] fix contrib path, you are no longer reading from container path

* netdata/packaging: [ci skip] fix version

* netdata/packaging: [ci skip] add dep

* netdata/packaging: [ci skip] fix changelog template

* netdata/packaging: [ci skip] Fix debian package build, we were looping through forever. Exclude contrib all together

* netdata/packaging: [ci skip] Add logic to gather all package related content from the container folder and push it for publishing

* netdata/packaging: [ci skip] fixes and nits
1) use the branch for the beta deployment
2) change the cp pattern

* netdata/packaging:[ci skip] add more debug info

* netdata/packaging: [ci skip] Adjust LXC directory permissions, so that the rest of the workflow can pull through

* netdata/packaging: [ci skip] Using expressions within double quotes doesnt work, use quotes only on the variable to avoid syntax warnings from shellchecking

* netdata/packaging: [ci skip] Update build deps

* netdata/packaging: Add runtime deps (hopefully)

* netdata/packaging: [ci skip] remove old distro

* netdata/packaging: [ci skip] dont let that space there, breaks the syntax

* netdata/packaging: [ci skip] missed one

* netdata/packaging: [ci skip] yank yank yank

* netdata/packaging: [ci skip] You missed www over there

* netdata/packaging: [ci skip] Remove broken distros (no container images). We will revisit the way to support multiple distros in a different way, lxc failed us

* netdata/packaging: Pull in go.d plugin, also fix chmod command to just pass the folder since with the -R doesnt require anything else

* netdata/packaging: [ci skip] Get cups, freeipmi and nfacct on

* netdata/packaging: [ci skip] pull different package in

* netdata/packaging: [ci skip] Install dependencies on the build machine

* netdata/packaging: [ci skip] dont do post-clean, not on all versions

* netdata/packaging: [ci skip] move go install seperately

* netdata/packaging: [ci skip] Towards a more appropriate go.d plugin install

* netdata/packaging: [ci skip] fix permissions setting

* netdata/packaging: [ci skip] fix freeipmi package install

* netdata/packaging: [ci skip] Fix build arch setting on the build command, also remove pre-clean, it breaks on debian/jessie

* netdata/packaging: [ci skip] fix postinst actions, we use libexec

* netdata/packaging: adjust www and go.d permissions

* netdata/packaging: [ci skip] Handle the different build tool version cases, also take care some dependency issues on older version jessie

* netdata/packaging: [ci skip] adjust the control file based on the distro

* netdata/packaging: [ci skip] Move control file preparation prior to packaging the source

* netdata/packaging: [ci skip] Adjust versioning scheme for the nightlies

* netdata/packaging: [ci skip] Let RPM be built too for testing

* netdata/packaging: [ci skip] Factor out version calculation

* netdata/packaging: [ci skip] Attempt to modify version properly

* netdata/packaging: [ci skip] Update documentationg regarding .DEB files

* netdata/packaging: [ci skip] autogen not available everywhere, also fix json-c deps

* netdata/packaging: Remove development settings, also remove beta deployment as its not needed
2019-07-15 22:00:31 +02:00
Vladimir Kobal
21cd00c84a Perf plugin (#6225)
* Add perf plugin skeleton

* Initialize events

* Collect data

* Configure default counters

* Add charts for hardware and software counters

* Add charts for cache counters

* Don't show zeroes for non-existent metrics

* Reinit events when stalled

* Do not reinit disabled events

* Update the documentation

* Scale values when multiplexing is happening
2019-06-20 15:23:29 +03:00
Vladimir Kobal
77781d033d Prometheus remote write backend (#6062)
* Add Prometheus remote write backend prototype

* Fix autotools issues

* Send HTTP POST request

* Add parameters to HTTP header

* Discard HTTP responce 200

* Update CMake build configuration

* Fix Codacy issue

* Check for C++ binary

* Fix compilation without remote write backend

* Add options to the installer script

* Fix configure script warning

* Fix make dist

* Downgrade to ByteSize for better compatibility

* Integrate remote write more tightly into the existing backends code

* Cleanup

* Fix build error

* Parse host tags

* Fix Codacy issue

* Fix counters for buffered data

* Rename preprocessor symbol

* Better error handling

* Cleanup

* Update the documentation
2019-06-07 10:48:32 +02:00
thiagoftsm
b6088e08a7 SSL implementation for Netdata (#5956)
* SSL implementation for Netdata

* Upload of fixes asked by @paulkatsoulakis and @cakrit

* Fix local computer

* Adding openssl to webserver

* fixing..

* HTTPS almost there

* Codacity

* HTTPS day 3

* HTTPS without Bio step 1

* HTTPS without Bio step 2

* HTTPS without Bio step 3

* HTTPS without Bio step 4

* HTTPS without Bio step 5

* HTTPS without Bio step 6

* HTTPS without Bio step 7

* HTTPS without Bio step 8

* HTTPS without Bio step 9

* HTTPS without Bio step 10

* SSL on streaming 1

* Daily pull

* HTTPS without Bio step 11

* HTTPS without Bio step 12

* HTTPS without Bio step 13

* HTTPS without Bio step 14

* SSL_Interception change documentation

* HTTPS without Bio step 15

* HTTPS without Bio step 16

* SSL_Interception fix codacity

* SSL_Interception fix doc

* SSL_Interception comments

* SSL_Interception fixing problems!

* SSL_Interception killing bugs

* SSL_Interception changing parameter

* SSL_Implementation documentation and script

* SSL_Implementation multiple fixes

* SSL_Implementation installer and cipher

* SSL_Implementation Redirect 301

* SSL_Implementation webserver doc and install-or-update.sh

* SSL_Implementation error 00000001:lib(0):func(0):reason(1)

* SSL_Implementation web server doc

* SSL_Implementation SEGFAULT on Fedora

* SSL_Implementation fix ^SSL=force|optional

* SSL_Implementation Redirect and Ciphers

* SSL_Implementation race condition 1

* SSL_Implementation Fix Location

* SSL_Implementation Fix Location 2

* SSL_Implementation Fix stream

* SSL_Implementation Fix stream 2

* SSL_Implementation Fix stream 3

* SSL_Implementation last problems!

* SSL_Implementation adjusts to commit!

* SSL_Implementation documentation permission!

* SSL_Implementation documentation permission 2!

* SSL_Implementation documentation permission 3!
2019-05-31 16:27:35 +02:00
George Moschovitis
4721ed4f14 Support for aggregate node view (#5902)
* Introduce sign-in banner

* Show/hide sign-in banner

* Improvements

* Fixed banner for white theme.

* Preliminary work on integrating console with agent

* Updated console

* Fetch js and css from cloud #431

* Minor

* Fixed for better console embedding

* Fixed a problem with the Makefile

* Minor

* Dynamically generate index fragment based on cloudBaseURL

* Relative path to console

* Added cache-busters

* Add Nodes view access

* Improved console/index.html

* Fixes in console/index

* Version bump

* Removed extraneous react import (thanks Nicolas)

* Use netdataNoBootstrap

* Use white theme

* Touch agent API call (updates lastseen timestamp)

* Revert to API version 1

* Move touch to init cloud

* Remove logs

* Updated js file href

* Nodes view on unsigned redirect

* Revert yellow color

* Remove comment

* Beta color update

* Move styles to CSS

* Cloud console link fix

* Remove cloudBaseUrl

* Use local dashboard.js, duh!

* Added GoogleTagManager

* Remove duplicate dashboard.js

* Analytics fix

Analytics fix
2019-05-15 15:50:01 +02:00
Vladimir Kobal
f0bc01ddbd Add ioping plugin (#5725)
* Add ioping plugin

* Update the documentation and comments

* Finalize installation of ioping

* Fix find_processors variable

* Fix static build

* Move ioping to libexec directory

* Move ioping to plugins.d directory

* Fix file existence check
2019-04-23 14:20:00 +03:00
Vladimir Kobal
b3f690e7c9 Add xenstat plugin (#5660)
* Add xenstat plugin

* Add basic domain charts

* Initialize xl context

* Use domain UUID instead of name

* Make charts obsolete

* Add tmem charts

* Change algorithm for tmem puts and gets

* Add VCPU charts

* Minor formatting for sending charts functions

* Add VBD charts

* Add network charts

* Assemble VCPU metrics in one chart

* Fix chart names

* Make write/sent dimensions negative

* Minor formatting

* Change id and context for domain charts

* Add dashboard info

* Get rid of global variables

* Free libxenstat and libxl resourses

* Free domain_metrics on VM shutdown

* Add domain state chart

* Add debug messages

* Add branch prediction hints

* Minor fix

* Fix chart obsoleting

* Make names more general

* Fix CMake build of nfacct.plugin
2019-03-27 11:19:24 +02:00
Thomas Hufschmidt
9752694007 Fix curl download (#5439)
* gitignore rules for generated files matched packaging content

* follow http redirects when downloading via curl (#5411)
2019-02-20 11:50:57 +01:00
Vladimir Kobal
ea0e0f8f5e Split nfacct plugin into separate process (#5361)
* Prepare build configuration

* Prepare plugin for separating

* Add command line options

* Add debug messages

* Use text API

* Minor fixes

* Update the documentation

* Minor documentation formatting

* Fix LGTM alerts

* Fix building with CMake

* Add nfacct and cups plugins to apps.plugin groups
2019-02-13 10:34:58 +01:00
Chris Akritidis
d054de0771 Add go.d documentation and modify collector menu (#5215)
docs/generator/buildyaml.sh
* Modified menu structure of collectors
* Added go.d plugin

docs/generator/buildhtml.sh
* Added go.d documentation (git clone). Clean up the go.d cloned dir before and after execution
* Replace page edit links to github for go.d.plugin. Removed nomkdocs option which doesn't work with this.
2019-02-06 16:00:41 +01:00
Simon Nagl
b6aeb7e3d9 CUPS plugin (#5188)
* Implement a CUPS collector plugin

* Compile cups.plugin only if enabled

* Fix build with CFLAGS

-O1 -ggdb -Wall -Wextra -Wformat-signedness -fstack-protector-all
-DNETDATA_INTERNAL_CHECKS=1 -D_FORTIFY_SOURCE=2 -DNETDATA_VERIFY_LOCKS=1

* cups.plugin check for all used functions

* Use cups-config to configure cups compiler flags

* Do not quit if cups-config is not installed

* Fix compiler warning

collectors/cups.plugin/cups_plugin.c:359:27:
warning: format '%d' expects argument of type 'int',
but argument 6 has type 'unsigned int' [-Wformat=]

* Add cups.plugin to toc and overview documentation

* cups.plugin fix plugin doc layout

* cups.plugin: Add prerequisites doc

* cups.plugin: Fix error if cups is not installed
2019-02-04 16:33:07 +02:00
George Moschovitis
b6ce817545 Cloud Sign-In (#5095)
* Manually merged changes from old hub-support branch, tracking #131

Call claim url #4771
Claim ui improvements #4771
Cleanup
Implement Sign Out
Introduced sign-in modal #3990
Added sign-in button
More work on the iframe trick
More work
More work on the logic, removed old obsolete stuff
Close modal
Implement account menu
Minor rename
Renamed my-netdata to My Agents
Show migrate button
Collect known agents
Work on migrateRegistryDidClick
Minor
Actually show agents from netdata cloud in the menu
Some cleanup
Keep all the alternate_urls for each agent
Fix for tooltips over SignIn/AccountMenu

* Actually use NETDATA.registry.cloudBaseURL

Tricky!

* Hide switch identity when signed-in #153

* Manually merged changes from old hub-support branch, tracking #131

Call claim url #4771
Claim ui improvements #4771
Cleanup
Implement Sign Out
Introduced sign-in modal #3990
Added sign-in button
More work on the iframe trick
More work
More work on the logic, removed old obsolete stuff
Close modal
Implement account menu
Minor rename
Renamed my-netdata to My Agents
Show migrate button
Collect known agents
Work on migrateRegistryDidClick
Minor
Actually show agents from netdata cloud in the menu
Some cleanup
Keep all the alternate_urls for each agent
Fix for tooltips over SignIn/AccountMenu

* Actually use NETDATA.registry.cloudBaseURL

Tricky!

* Hide switch identity when signed-in #153

* Cleanup

* Refresh menu on sign-in

* Disable cloud functionality if cloud base url is not set.

This wll allow the merging of the branch into master, so we can avoid nasty rebases.

* Updated to use the latest API endpoints

* Fixed a couple of LGTM warnings

* Improved migration algorithm, some cleanup.

* Update My-Netdata menu on sign-out

* Minor

* Replaced modal with window

* Update the My-Agents menu after migration, cleanup

* Make the agent work after switching cloudBaseURL, cleanup

* Introduced event tracing for analytics

* Minor

* Removed GA

* Fixed error reported by LGTM

* Only send the diff when syncing agents to ameliorate the load on the backend, cleanup

* Reverted My-Netdata name, added some logging

* Add Netdata Cloud menu item

* Minor

* Use the merge: false option and a fix

* Added loading message in my-netdata menu

* Show error if we cannot connect to netdata.cloud

* Minor

* Implemented deleteCloudKnownAgentURL api call, use it in my-netdata menu.

* Removed menu entry

* Disable my-netdata menu if user is not signed-in and using the global registry

* Stop accessing the registry if it's not used.

* Mask the agent url if the registry is in 'disabled' mode

* Filter masked urls

* Improved filtering of masked urls

* Try to eagerly initialize the account ui to improve perceived performance

* Minor

* Don't search for other people's urls in cloud-enabled mode.

* Added basic my-netdata filtering

* Filter streamed host, aesthetic fixes

* Minor

* Some improvements of the filter ui

* Removed What is this

* Added placeholder to input, other fixes #240

* Show message if no databases match filter criteria

* Fixed bug where agent lists where not merged

* Minor

* Hide modal if it redirects to self.

* autocomplete off for filter input

* Enable delete for custom registries, don't show error if delete fails

* Filter agents without urls

* Fix LGTM warning

* Minor

* Concatenate at client side, used the faster merge: false path

* Added a clear button to the filter for extra usability

* Minor

* Minor

* Improvements for small screens (more needed)

* Combined  my-netdata menu and hostname

* Re-enabled registry masking

* Show agent-filter only when signed-in

* Improved syncAgents

* Don't mask if using custom registry

* Reject agents with empty urls

* Filter valid agents

* Fixed a couple of bugs

* Applied Chris' fixes

* Fix in registry.c

* Cleanup

* Only sync once

* Implemented forceSync

* Added what is this

* sso, wip

* Working SSO sign-in/sign-out, cleanup

* Added Chris' patch

* Added a modal that explains what synchronize is doing

* Use sso-agent

* Use origin as query param in sign-in

* iframe -> origin

* Pass machine_guid to sso

* Make sure that the current netdata agent is synchronized hub#262

* Normalize originURL

* Reenable tryFastInitCloud()

* Updated to the latest endpoints

* Support synchronizing to multiple cloud accounts

* Set default cloud base url to netdata.cloud

* Fix filter issues with Firefox

* Fix for double tooltip on sign-in

* Show known servers in console for debugging purposes

* Don't block on errors to delete from registry when signed in

* Disable tryFastInitCloud

* Improved styling for filter input

* Improved styling in my-netdata menu

* Display the registry url in the sync-registry modal

* agents -> nodes in texts

* Support for sso-precheck

* Do not implicitly synchronize custom registries.

* Improvement to syncAgents (more coming)

* More fixes

* Don't sign in users with private registries if they don't consent on the sync

* Set netdataRegistryAfterMs = 0

* Don't pass url to sso-agent

* Added Chris' patch to alarm-notify

* Refactored syncAgent/mergeAgents, make sure current Agent is synced on sign-in.

* Fix for LGTM warning

* Minor

* Fix for a XSS warning

* Extra check for dataLayer
2019-01-28 12:27:42 +02:00
Chris Akritidis
2a5074ad43 Anonymous statistics (#5113)
* Added shell and dashboard anonymous statistics

* Check for environment var NETDATA_REGISTRY_UNIQUE_ID

* Fix indentation

* Removed health-cmdapi-test

* docs/anonymous-statistics.md
2019-01-27 12:35:09 +02:00
Chris Akritidis
08649bec37 Port ACLs, Management API and Health commands (#4969)
##### Summary
fixes #2673 
fixes #2149
fixes #5017 
fixes #3830 
fixes #3187 
fixes #5154

Implements a command API for health which will accept commands via a socket to selectively suppress health checks. 

Allows different ports to accept different request types  (streaming, dashboard, api, registry, netdata.conf, badges, management)

Removes support for multi-threaded and single-threaded web servers.

##### Component Name
health, daemon
2019-01-15 12:49:28 +01:00
Paweł Krupa
0d9835386e better artifacts uploading (#5130) 2019-01-08 14:50:44 +01:00
Paweł Krupa
8839f96e1f copy updater script instead of linking it (#5010)
* copy updater script instead of linking it

fix lifecycle test

* better installation msg

* updater and uninstaller shouldn't be in .gitignore

* discard copied uninstaller script
2019-01-02 11:03:17 +01:00
Paweł Krupa
4d77f2b325 move makeself (#4688) 2019-01-02 10:12:24 +01:00
George Moschovitis
844043b3a5 Removed c3, morris and raphael JS libraries (#5086) (#5088) 2018-12-31 19:14:45 +02:00
Paweł Krupa
f4fbf21363 copy artifacts to 'upload/' (#5036) 2018-12-19 11:18:07 +01:00
Paweł Krupa
a0c21fe1d6 add new generation uploading schema (#5018) 2018-12-17 19:36:24 +01:00
Paweł Krupa
997a529769 Better updater (#4558) 2018-11-29 23:39:19 +02:00
Paweł Krupa
5ed8653246 Rename doc to docs and move htmldoc (#4741)
* rename doc dir; move htmldoc under docs/generator

* run shellcheck and shfmt on docs generator
2018-11-25 20:11:50 +02:00
Chris Akritidis
3aae8f6c2c Htmldoc (#4607)
* First html documentation debug set

* Test 2

* Relative path changed

* Updated comments

* Cleanup, installation draft added

* fixes

* test

* test

* test

* First html documentation debug set

* Test 2

* Relative path changed

* Updated comments

* Cleanup, installation draft added

* fixes

* test

* test

* test

* First set of major cleanup/deduplication

* 2nd major cleanup

* update getting started structure

* Cleanup in using netdata

* Final cleanup/deduplication

* Added initial CONTRIBUTING.md, updated some info related to contributing on the orchestrators

* Removed Why-Netdata (included in new README in master), added link to CONTRIBUTING.md

* First html documentation debug set

* Updated Makefile.am to ignore the new md and htmldoc generation files

* Removing files from rebase

* First html documentation debug set

* Test 2

* Relative path changed

* Updated comments

* Cleanup, installation draft added

* fixes

* test

* test

* test

* First html documentation debug set

* Test 2

* Relative path changed

* Updated comments

* Cleanup, installation draft added

* test

* test

* First set of major cleanup/deduplication

* 2nd major cleanup

* update getting started structure

* Cleanup in using netdata

* Final cleanup/deduplication

* Added initial CONTRIBUTING.md, updated some info related to contributing on the orchestrators

* Removed Why-Netdata (included in new README in master), added link to CONTRIBUTING.md

* First html documentation debug set

* Updated Makefile.am to ignore the new md and htmldoc generation files

* Removing files from rebase

* Fixed Makefile.am

* Same line header and badges

* Fixed broken link

* CPU monitoring is in apps plugin

* Removed obsolete files

* Remove obsolete files

* - Make the Health API part of health/README.md new file web/api/health/README.md
- Make installer/LAUNCH.md part of deamon/README.md
- Move installer/MAINTAINERS.md to packaging/maintainers/README.md
- Move installer/DOCKER.md to docker/README.md
- Move system/README.md to daemon/config/README.md
- Move web/CUSTOM-DASHBOARDS.md to web/gui/custom/README.md
- Move web/CONFLUENCE-DASHBOARDS.md to web/gui/confluence/README.md

* Resolve codacy issue $(..) syntax instead of `..`

* Fix following warnings and add svgs to the data_structures/README.md
  - CHANGELOG.md
  - CODE_OF_CONDUCT.md
  - CONTRIBUTORS.md
  - REDISTRIBUTED.md
  - diagrams/data_structures/README.md
  - docker/README.md
WARNING -  Documentation file 'README.md' contains a link to 'collectors/plugins.d' which does not exist in the documentation directory.
WARNING -  Documentation file 'README.md' contains a link to 'collectors/statsd.plugin' which does not exist in the documentation directory.
WARNING -  Documentation file 'CONTRIBUTING.md' contains a link to 'web/CUSTOM-DASHBOARDS.md' which does not exist in the documentation directory.
WARNING -  Documentation file 'CONTRIBUTING.md' contains a link to 'web/CONFLUENCE-DASHBOARDS.md' which does not exist in the documentation directory.

* Wrong urls in data_structures/README.md svgs

* Fix svg URLs number 2

* Modify the first line of the main README.md, to enable proper static html generation. Executed after copying the file to htmldoc/src

* Added back Why Netdata

* Fixed link to registry in Why-Netdata.md

* Added Why-Netdata to buildyaml and to Makefile.am

* Replaced http links causing mixed content warnings

* Made buildhtml ignore the directory node_modules created by Netlify

* Corrected CONTRIBUTING.MD to CONTRIBUTING.md
2018-11-12 22:34:59 +02:00
Paweł Krupa
97187d52db new releaser (#4526) 2018-10-31 18:02:50 +02:00
Costa Tsaousis
0a78758a11 updated tests for the new hierarchy (#4464) 2018-10-24 00:35:56 +03:00
Costa Tsaousis
e76aac74e6 moved related wiki pages into the repo (#4428)
* moved related wiki pages into the repo

* updated web server docs

* fixed typos
2018-10-18 17:31:52 +03:00