Commit Graph

1021 Commits

Author SHA1 Message Date
Andrew Zhao
4a0b10984a Bump videojs and fix webworker 2021-01-29 19:08:28 -05:00
saltycrys
70e14f92a4 Only start refresh jobs when necessary
If `channel_threads` or `feed_threads` is set to zero the corresponding job is
now not started.
2021-01-23 19:45:42 +01:00
saltycrys
b45f371911 Make config a constant
Instead of passing around `config` there is now the global `CONFIG`.
2021-01-23 19:39:04 +01:00
saltycrys
f1a7ee997b Add config environment variables
The config file can now be specified with `INVIDIOUS_CONFIG_FILE`.
A YAML formatted string can still be passed with `INVIDIOUS_CONFIG`, replacing
the config file.

Additionally all options can now be specified as environment variables.
The syntax for variable names is `INVIDIOUS_` followed by the option name in
upper case. The values are parsed as YAML.

These new env vars only update the provided main configuration, but it is
possible to point the config file at the example config and then use env vars
for all config options:
```
INVIDIOUS_CONFIG_FILE=./config/config.example.yml \
INVIDIOUS_CHANNEL_THREADS=10 \
./invidious
```
2021-01-23 18:58:13 +01:00
TheFrenchGhosty
799f97e847 Make invidious use all the translation files 2021-01-23 18:07:55 +01:00
Andrew Zhao
b7fe1db89a save host when using dash manifest 2021-01-10 18:00:45 -05:00
saltycrys
c81ca187f8 Fix downloads
The `itag` is now converted to a number, matching the `itag` of
`Video.adaptive_fmts` and `Video.fmt_stream`.
2021-01-09 20:40:01 +01:00
saltycrys
b0b8ba7000 Respect use_pubsub_feeds config
Setting `use_pubsub_feeds: false` now properly disables it.
2021-01-07 20:52:32 +01:00
saltycrys
6365ee7487 Make logger a constant
Instead of passing around `logger` there is now the global `LOGGER`.
2021-01-05 20:43:19 +01:00
saltycrys
7a8620a570 Add CLI arguments to config file
The log level can now be set with `log_level` (accepts ints and strings).
The log file can now be set with `output` (also accepts `STDOUT`).
2021-01-05 20:35:59 +01:00
Perflyst
2c24bf3222
Merge pull request #1389 from vhuynh3000/decrypt_on_demand
add config to decrypt on demand instead of polling
2021-01-05 19:32:22 +01:00
saltycrys
36e9fb9d68 Fix watch_videos endpoint
Playlists created by `watch_videos` do not have an author which caused a crash
previously.
2021-01-04 05:35:59 +01:00
vhuynh3000
3a2bd4e928 add config to decrypt on demand instead of polling 2021-01-03 20:50:52 +01:00
Perflyst
c89632d2a8
Merge pull request #1608 from saltycrys/add-subscription-traces
Add Subscription Traces
2020-12-31 11:30:04 +01:00
TheFrenchGhosty
82c8f3b556
Merge pull request #1600 from jksladjflkjsadflkjsadf/closeclients
Close http clients after use
2020-12-30 01:14:31 +00:00
Perflyst
b19524d56a
Merge pull request #1609 from saltycrys/add-popular-enabled-option
Add `popular-enabled` option
2020-12-28 11:30:55 +01:00
Andrew Zhao
e0d25ff887 Close http clients after using
The crystal http client maintains a keepalive connection to the other
server which stays alive for some time. This should be closed if the
client instance is not used again to avoid hogging resources
2020-12-27 19:40:58 -05:00
saltycrys
198dfffaeb Add popular-enabled option
This is similar to the removed `top-enabled` option but for the Popular feed.
The instance needs to be restarted if the feed was enabled.

Editing admin options on the preferences page is also fixed.

The handling of the feed pages now only happens in a single place.

Instead of redirecting:
  - The Top feed now displays a message that it was removed from Invidious.
  - The Popular feed now displays a message that it was disabled if it was.
2020-12-27 06:12:43 +01:00
saltycrys
c4ef055248 Add RefreshChannelsJob traces
Traces can be enabled with `-l trace`.

The problem with subscriptions is that sometimes requests to YouTube never
finish. As soon as that happens `channel-threads` times subscriptions stop
being refreshed. This is most likely a problem with the lsquick bindings.
2020-12-27 05:20:33 +01:00
Perflyst
8df591e8d4
Merge pull request #1595 from saltycrys/improve-storyboards
Improve storyboards
2020-12-23 14:30:10 +01:00
saltycrys
75c6844b66 Improve storyboards
Instead of limiting the width of storyboards through CSS it is now done in the
VTT directly.
2020-12-21 17:02:36 +01:00
saltycrys
b39f01dcdf Improve logging
Everything that gets logged now has a log level associated with it.

The log level can be set with the new `-l` or `--log-level` arguments.

The defaul log level is `debug` for now. There aren't many things that get
logged but if the logs get spammed in the future it can be set down to `info`.
2020-12-21 16:32:34 +01:00
Matthew McGarvey
fb06482916 Extract out User Preferences endpoints 2020-12-15 18:54:30 -06:00
Amanda Graven
848add1b1b
Set channel thumbnail as icon for feeds (#1106) 2020-12-14 19:25:39 +01:00
Matthew McGarvey
2dacdf0210 Extract login/signout routes from global file 2020-12-08 20:50:39 -06:00
Andrew Zhao
0cb442d40e do not proxy hls on supported browser 2020-12-08 00:53:48 -05:00
Lukas
62e8c09183 Fix YouTube subscription import parser 2020-12-06 21:47:50 +01:00
saltycrys
4184fb3ae7
Increase YouTube request timeout (#1540)
Increase YouTube request timeout
2020-12-06 12:12:02 +00:00
Sonic-Y3k
03d0b296e1
Fix invidious version for docker image
As Alpine-Linux per default uses the busybox date command, the -f option is not available and the build will fail.
2020-12-05 20:06:24 +01:00
saltycrys
adccca366e Fix invidious version for old git versions
The `%cs` format was only added to git in version 2.25 while `%ci` has been
around forever.
2020-12-04 01:58:27 +01:00
Matthew McGarvey
d7377015a2 Extracting search endpoints 2020-12-01 18:02:39 -06:00
saltycrys
2478e67d16 Switch to date based versioning scheme
Since no new tags are created for releases the version has been frozen for some
time, with only the commit hash changing.

Versions based on the latest commit date make it much easier to identify them.
2020-12-01 13:29:30 +01:00
saltycrys
3dac33ffba
Add backtraces to errors (#1498)
Error handling has been reworked to always go through the new `error_template`,
`error_json` and `error_atom` macros.
They all accept a status code followed by a string message or an exception
object. `error_json` accepts a hash with additional fields as third argument.

If the second argument is an exception a backtrace will be printed, if it is a
string only the string is printed. Since up till now only the exception message
was printed a new `InfoException` class was added for situations where no
backtrace is intended but a string cannot be used.

`error_template` with a string message automatically localizes the message.
Missing error translations have been collected in https://github.com/iv-org/invidious/issues/1497
`error_json` with a string message does not localize the message. This is the
same as previous behavior. If translations are desired for `error_json` they
can be added easily but those error messages have not been collected yet.

Uncaught exceptions previously only printed a generic message ("Looks like
you've found a bug in Invidious. [...]"). They still print that message
but now also include a backtrace.
2020-11-30 10:59:21 +01:00
Matthew McGarvey
192d2b86b6 Extract playlist routes from global file 2020-11-19 19:21:48 -06:00
Matthew McGarvey
dda02f783f Extract embed routes into separate classes 2020-11-06 16:44:36 -06:00
Perflyst
cda322e311
Merge pull request #1449 from raycheung/master
Fix stale playlist video counting on add/drop (#1448)
2020-11-03 17:39:34 +01:00
Matthew McGarvey
2cded8dcac Extract /watch route from main file 2020-11-02 18:06:06 -06:00
Ray Cheung
babe0c31ad Fix stale playlist video counting on add/drop (https://github.com/iv-org/invidious/issues/1448)
The return of `cardinality()` is not affected by the `array_append()`
and `array_remove()` of the same statement.
2020-11-01 12:20:44 +08:00
saltycrys
9a8b81fcbe Fix storyboards 2020-10-25 09:35:16 +01:00
Matthew McGarvey
0520e67303
[refactor] Finish converting jobs to new job setup (#1420)
[refactor] Finish converting jobs to new job setup
2020-10-17 12:25:57 +00:00
Matthew McGarvey
d571573e52
Set preferences before conditional breaks in before_all (#1412) 2020-10-16 10:23:18 +00:00
Matthew McGarvey
989317e5d3
Extract RefreshChannelsJob (#1403) 2020-10-15 14:22:41 +00:00
Matthew McGarvey
85c212aee3 Provide rough draft of better project organization 2020-10-05 23:57:19 -05:00
Omar Roth
b88872d54b
Fix sub refresh (#1370) 2020-09-09 23:03:27 +00:00
stranger195
13f58d602f
Replace omarroth with iv-org where applicable (#1353)
Fixes #1353
2020-08-25 16:07:16 +00:00
Omar Roth
62f015fc34
Fix playlist export for playlists with more than 100 videos 2020-07-28 17:21:39 -04:00
Omar Roth
452d1e8307
Fix warnings with latest version of Crystal 2020-07-26 10:59:31 -04:00
Omar Roth
92f337c67e
Add playlist import/export 2020-07-26 10:59:31 -04:00
Omar Roth
1eca969cf6
Add support for polymer redesign 2020-06-15 18:18:04 -05:00
Omar Roth
c1cbdae5ee
Make HOST_URL constant 2020-06-15 18:13:14 -05:00
Omar Roth
4d4b6a2fa0
Remove top page 2020-06-15 18:11:36 -05:00
Omar Roth
d30a972a90
Support Crystal 0.35.0 2020-06-15 18:11:06 -05:00
Dmitry Sandalov
5d8de5fde2
Allow user to subscribe to playlist (#17) 2020-05-17 14:28:00 +03:00
Omar Roth
454ae8656a
Cleanup request headers 2020-05-08 09:00:53 -05:00
Omar Roth
97eb01a28d
Merge weblate 2020-04-20 16:46:00 -05:00
Omar Roth
7bb7003c9d
Fix authorThumbnails in /api/v1/channels 2020-04-10 11:49:51 -05:00
Omar Roth
920463f2ff
Fix playlist_ajax 2020-04-10 11:49:18 -05:00
Omar Roth
ca1185d0be
Fix warnings in latest version of Crystal 2020-04-09 12:18:09 -05:00
Omar Roth
3f97bebd69
Support adding video to playlist from watch page 2020-04-09 10:55:32 -05:00
Omar Roth
2e378da922
Add support for Swedish locale 2020-04-04 15:57:29 -05:00
Omar Roth
b37f51bd7f
Fix /c/ redirect 2020-04-04 15:31:24 -05:00
Omar Roth
92798abb5d Add manifest-src to CSP 2020-03-19 13:41:08 -05:00
leonklingele
70cbe91776
Migrate to a good Content Security Policy (#1023)
So attacks such as XSS (see [0]) will no longer be of an issue.

[0]: https://github.com/omarroth/invidious/issues/1022
2020-03-15 16:46:08 -05:00
Omar Roth
1443335315
Switch textcaptcha to HTTPS 2020-03-10 11:12:11 -04:00
Omar Roth
bb72672dd9
Replace static asset requests with QUIC 2020-03-06 13:53:35 -05:00
Omar Roth
d96dee3aa6
Add debug info to videoplayback 2020-03-06 13:50:00 -05:00
Omar Roth
bd0aaa343b
Prevent storyboards from hanging 2020-03-05 13:49:06 -05:00
Omar Roth
697c00dccf
Sanitize PLID 2020-02-28 14:10:01 -05:00
Omar Roth
1caf6a3298
Fix deadlock when updating notifications 2020-02-28 13:13:48 -05:00
Omar Roth
02fd02d482
Remove DB array concatenation 2020-02-28 12:14:29 -05:00
Leon Klingele
bc9dc3bf1e
Update code formatting for Crystal 0.33.0
Crystal 0.33.0 introduced some changes to to the code formatter.
Run "crystal tool format" so CI doesn't fail anymore.
2020-02-15 19:52:28 +01:00
Leon Klingele
e3c10d779d
Add support to read config from environment variable
Try to read app config from the "INVIDIOUS_CONFIG" environment variable.
If the variable is undefined, read config from config.yml file as before.

Required by https://github.com/omarroth/invidious/pull/1015 et al.
2020-02-04 15:53:46 +01:00
Omar Roth
648cc0f006
Refactor signature extraction 2020-01-24 17:02:28 -05:00
Omar Roth
7baced75e5
Fix channel redirect 2020-01-14 08:21:17 -05:00
Omar Roth
7b88d0efe3
Minor refactor 2020-01-08 20:27:21 -05:00
Omar Roth
0e844edacb
Add support for pt-BR 2019-12-05 15:26:35 -05:00
Omar Roth
1499ce43bf
Add support for Romanian locale 2019-12-03 19:41:58 -05:00
Omar Roth
062867a38d
Strip domain from caption URLs 2019-12-01 17:52:39 -05:00
Omar Roth
04d56420d1 Run 'crystal tool format' 2019-11-28 08:20:44 -06:00
Omar Roth
a017574f74 Add support for force_resolve to QUIC client 2019-11-28 08:19:28 -06:00
Omar Roth
0e3a48ff76
Update QUICPool 2019-11-24 13:41:47 -05:00
Omar Roth
276bf09238
Skip preferences for assets 2019-11-20 12:04:53 -05:00
Omar Roth
d46b26e3bc
Use QUIC for connections to YouTube 2019-11-18 17:28:32 -05:00
Omar Roth
8af87f1a8b
Fix updating of cookies 2019-11-10 10:02:02 -05:00
Omar Roth
494c954cbb
Add etag to /api/v1/annotations 2019-11-09 22:05:17 -05:00
Omar Roth
71bc9eea28
Add support for Anti-Captcha 2019-11-09 14:22:39 -05:00
Omar Roth
7b2ca55089
Fix escaping in email query 2019-11-04 12:26:05 -05:00
Omar Roth
02e1cdf210
Add support for '/yts/img' endpoint 2019-11-01 12:02:38 -04:00
Omar Roth
03e24cccd0
Add support for configurable administrator email 2019-10-27 14:18:07 -04:00
Omar Roth
35f011758d
Merge pull request #850 from XVnNzb2kFEhV9Tjm/master
Add Japanese translations
2019-10-27 14:09:31 -04:00
Omar Roth
2ebfaf76f2
Refactor continuation token handling 2019-10-27 13:50:42 -04:00
Omar Roth
0cf187dee7
Add support for image captcha in Google login 2019-10-27 00:19:05 -04:00
Omar Roth
bdeb325bad
Fix monkeypatch for HTTP::Client 2019-10-26 11:51:23 -04:00
XVnNzb2kFEhV9Tjm
f0368b02c4 Add Japanese translations 2019-10-26 18:34:25 +09:00
Omar Roth
6930570fa2
Add HTTPClient pool 2019-10-25 12:58:16 -04:00
Omar Roth
aba2c5b938
Remove code for /api/v1/insights 2019-10-25 12:25:57 -04:00
Omar Roth
159b4f9734
Format source 2019-10-21 21:40:03 -04:00
Omar Roth
46a737c7a1
Skip deleted videos in playlist 2019-10-21 19:00:56 -04:00
Omar Roth
007646774e
Fix typo in English locale 2019-10-20 21:01:27 -04:00
Omar Roth
2d78e35e16
Fix typo in syncing user preferences 2019-10-20 20:58:50 -04:00
Omar Roth
7524b5e349
Move feed_menu and default_home into user preferences 2019-10-20 20:43:33 -04:00
Omar Roth
2a04a48b89
Fix redirect for livestreams 2019-10-20 12:48:55 -04:00
Omar Roth
bf48809b61
Allow unlisted playlists to be viewed from /api/v1/playlists/ 2019-10-16 08:21:26 -04:00
Omar Roth
3f3e52d7ae
Fix indexId for created playlist video 2019-10-15 22:09:01 -04:00
Omar Roth
be055d9dcb
Add support for custom playlists 2019-10-15 21:17:14 -04:00
Omar Roth
97bd1da2a2
Remove SSL redirect 2019-10-14 21:07:07 -04:00
Omar Roth
f5c7bbfda8
Add support for zh-TW translation 2019-10-09 10:23:26 -04:00
Omar Roth
eef66de68c
Merge pull request #743 from girst/rssparams
Forward query string parameters from Atom feeds
2019-09-30 15:36:35 -04:00
girst
4aa1180fce Forward parameters given in &params= from Atom feeds
Any parameters given in &params=... are appended to /watch URLs.  This
allows e.g. passing &raw=1&listen=1 to a playlist of music and use an
rss reader like newsboat as a media player, like so:

    https://invidio.us/feed/playlist/XXX?params=%26raw%3D1%listen%3D1

All three feeds--channels, playlists, subscriptions--are supported.
2019-09-30 17:48:13 +02:00
Omar Roth
4361ea9686
Update DB calls for 0.31.0 2019-09-24 13:38:50 -04:00
Omar Roth
8c2ddb0255
Add config options for host binding and port 2019-09-24 13:38:50 -04:00
Omar Roth
466a5a932b
Add support for Turkish translation 2019-09-24 13:38:50 -04:00
leonklingele
1aefc5b540 Update to Crystal 0.31.0, resolve compiler deprecation warnings, update dependencies (#764)
* shard: update to crystal 0.31.0

Additionally, no longer use the Crystal "markdown" library which has
been removed from the Crystal stdlib in version 0.31.0.
See https://github.com/crystal-lang/crystal/pull/8115.

Also fix some deprecation warnings using the following commands:

    find . \( -type d -name .git -prune \) -o -type f -exec sed -i 's/URI\.escape/URI\.encode_www_form/g' "{}" \;
    find . \( -type d -name .git -prune \) -o -type f -exec sed -i 's/URI\.unescape/URI\.decode_www_form/g' "{}" \;
    sed -i 's/while \%pull\.kind \!\= \:end_object/until \%pull\.kind\.end_object\?/g' src/invidious/helpers/patch_mapping.cr
2019-09-24 13:31:33 -04:00
Omar Roth
1085ca4a2d
Fix typo in Google login 2019-09-22 09:54:54 -04:00
Omar Roth
a006963fb8
Update Google login 2019-09-21 20:06:08 -04:00
Omar Roth
68cf24d100
Add support for channel redirects 2019-09-08 12:08:59 -04:00
Omar Roth
512d82071e
Fix invalid viewCountText in related videos 2019-08-31 15:58:38 -04:00
Omar Roth
45ad212459
Handle redirects in /videoplayback 2019-08-27 09:53:44 -05:00
Omar Roth
26107bd6c3
Minor refactor 2019-08-27 08:08:26 -05:00
Omar Roth
059f50dad4
Add 'playlistThumbnail' to playlist objects 2019-08-21 19:08:11 -05:00
Omar Roth
9f9cc1ffb5
Refactor search extractor 2019-08-21 18:23:20 -05:00
Omar Roth
2b94975345
Fix playlist_thumbnail extractor 2019-08-16 20:06:21 -05:00
Omar Roth
a19cdb5e72
Fix season playlists 2019-08-16 15:46:59 -05:00
psvenk
f54fbd057e Add prefers-color-scheme support (#601)
* Add prefers-color-scheme support

This should fix <https://github.com/omarroth/invidious/issues/559>.
The cookie storage format has been changed from boolean
("true"/"false") to tri-state ("dark"/"light"/""), so that users
without a cookie set will get dark mode if they have enabled the dark
theme in their operating system. The code for handling the cookie
state, along with the user's operating system theme, has been factored
out into a new function `update_mode`, which is called both at window
load and at the "storage" event listener, because the "storage" event
listener is only trigerred when a change is made to the localStorage
from another tab/window (for more info - see
<https://stackoverflow.com/a/4679754>).
2019-08-15 11:29:55 -05:00
Omar Roth
f6f176afc1
Merge pull request #680 from leonklingele/add-player-styles
Add support for player styles
2019-08-09 13:49:51 -05:00
Omar Roth
2d955dae48
Force redirect for videos without audio 2019-08-09 10:36:22 -05:00
Leon Klingele
46577fb128
Add support for player styles
This currently includes the following styles:

- Invidious, the default
- YouTube, using a centered play button and always visible video control bar

Implements https://github.com/omarroth/invidious/issues/670.
Supersedes https://github.com/omarroth/invidious/pull/661.
2019-08-09 02:04:36 +02:00
Omar Roth
5680d5a7be
Sort dash representations by framerate 2019-08-02 15:24:38 -05:00
Omar Roth
dce5816b18
Fix image url extractor 2019-07-31 19:16:09 -05:00
leonklingele
f99a7b2a8c Fix engagement for zero-view videos (#654)
Division by zero resulted in 'NaN'.

Fixes https://github.com/omarroth/invidious/issues/653.
2019-07-31 09:48:45 -05:00
Omar Roth
ff5d79e3ee
Update video extractor 2019-07-29 19:41:45 -05:00
Omar Roth
4ee3ec09df
Autofill search for playlists and communities page 2019-07-27 08:51:10 -05:00
Omar Roth
cfe9d47fa0
Add support for '/embed/?list' 2019-07-25 10:36:35 -05:00
Omar Roth
607d6125fc
Add support for '/embed/live_stream' 2019-07-24 19:18:26 -05:00
Omar Roth
6215259565
Add support for Google login verification 2019-07-22 13:28:36 -05:00
Omar Roth
d97a272aa5
Fix check for 2-step verification 2019-07-18 21:52:24 -05:00
Omar Roth
fea20ea913
Add support for Icelandic translation 2019-07-12 21:07:40 -05:00
Omar Roth
b0dca2a363
Minor refactor 2019-07-12 21:00:50 -05:00
Omar Roth
1a7b341745
Update Google login 2019-07-12 12:04:39 -05:00
Omar Roth
bb096a0357
Raise 400 on invalid request to '/feed/webhook' 2019-07-10 11:26:05 -05:00
Omar Roth
aa3c1d930b
Remove empty representations from dash manifests 2019-07-09 10:08:27 -05:00
Omar Roth
bcd239ac2b
Add community page 2019-07-09 09:31:04 -05:00
Omar Roth
2cc25b1e6e
Add administrator option to disable proxying 2019-07-08 12:15:18 -05:00
Omar Roth
c34a24b633
Attempt to optimize query for subscription feed 2019-07-07 14:00:42 -05:00
Omar Roth
775612ec5a
Prevent embeds from appearing in watch history 2019-07-05 16:55:28 -05:00
Omar Roth
5a455ec4f7
Fix redirect for livestream segments 2019-07-05 12:08:39 -05:00
Omar Roth
1277c3d156
Fix chunk size for livestreams 2019-07-05 11:35:04 -05:00
Omar Roth
8033d1ca6d
Fix chunking for livestream segments 2019-07-05 11:02:12 -05:00
Omar Roth
28df6881a7
Try to prevent redirect for DASH streams 2019-07-04 23:29:28 -05:00
Omar Roth
e5fa5df7be
Chunk video files to bypass throttling 2019-07-04 23:29:28 -05:00