Part VII. Internals

This part contains assorted information that might be of use to LightDB developers.

Table of Contents

48. Overview of LightDB Internals
48.1. The Path of a Query
48.2. How Connections Are Established
48.3. The Parser Stage
48.4. The LightDB Rule System
48.5. Planner/Optimizer
48.6. Executor
49. System Catalogs
49.1. Overview
49.2. pg_aggregate
49.3. pg_am
49.4. pg_amop
49.5. pg_amproc
49.6. pg_attrdef
49.7. pg_attribute
49.8. pg_authid
49.9. pg_auth_members
49.10. pg_cast
49.11. pg_class
49.12. pg_collation
49.13. pg_constraint
49.14. pg_conversion
49.15. pg_database
49.16. pg_db_role_setting
49.17. pg_default_acl
49.18. pg_depend
49.19. pg_description
49.20. pg_enum
49.21. pg_event_trigger
49.22. pg_extension
49.23. pg_foreign_data_wrapper
49.24. pg_foreign_server
49.25. pg_foreign_table
49.26. pg_index
49.27. pg_inherits
49.28. pg_init_privs
49.29. pg_language
49.30. pg_largeobject
49.31. pg_largeobject_metadata
49.32. pg_namespace
49.33. pg_opclass
49.34. pg_operator
49.35. pg_opfamily
49.36. pg_partitioned_table
49.37. pg_policy
49.38. pg_proc
49.39. pg_publication
49.40. pg_publication_rel
49.41. pg_range
49.42. pg_replication_origin
49.43. pg_rewrite
49.44. pg_seclabel
49.45. pg_sequence
49.46. pg_shdepend
49.47. pg_shdescription
49.48. pg_shseclabel
49.49. pg_statistic
49.50. pg_statistic_ext
49.51. pg_statistic_ext_data
49.52. pg_subscription
49.53. pg_subscription_rel
49.54. pg_tablespace
49.55. pg_transform
49.56. pg_trigger
49.57. pg_ts_config
49.58. pg_ts_config_map
49.59. pg_ts_dict
49.60. pg_ts_parser
49.61. pg_ts_template
49.62. pg_type
49.63. pg_user_mapping
49.64. System Views
49.65. pg_available_extensions
49.66. pg_available_extension_versions
49.67. pg_config
49.68. pg_cursors
49.69. pg_file_settings
49.70. pg_group
49.71. pg_hba_file_rules
49.72. pg_indexes
49.73. pg_locks
49.74. pg_matviews
49.75. pg_policies
49.76. pg_prepared_statements
49.77. pg_prepared_xacts
49.78. pg_publication_tables
49.79. pg_replication_origin_status
49.80. pg_replication_slots
49.81. pg_roles
49.82. pg_rules
49.83. pg_seclabels
49.84. pg_sequences
49.85. pg_settings
49.86. pg_shadow
49.87. pg_shmem_allocations
49.88. pg_stats
49.89. pg_stats_ext
49.90. pg_tables
49.91. pg_timezone_abbrevs
49.92. pg_timezone_names
49.93. pg_user
49.94. pg_user_mappings
49.95. pg_views
50. Frontend/Backend Protocol
50.1. Overview
50.2. Message Flow
50.3. SASL Authentication
50.4. Streaming Replication Protocol
50.5. Logical Streaming Replication Protocol
50.6. Message Data Types
50.7. Message Formats
50.8. Error and Notice Message Fields
50.9. Logical Replication Message Formats
50.10. Summary of Changes since Protocol 2.0
51. LightDB Coding Conventions
51.1. Formatting
51.2. Reporting Errors Within the Server
51.3. Error Message Style Guide
51.4. Miscellaneous Coding Conventions
52. Native Language Support
52.1. For the Translator
52.2. For the Programmer
53. Writing a Procedural Language Handler
54. Writing a Foreign Data Wrapper
54.1. Foreign Data Wrapper Functions
54.2. Foreign Data Wrapper Callback Routines
54.3. Foreign Data Wrapper Helper Functions
54.4. Foreign Data Wrapper Query Planning
54.5. Row Locking in Foreign Data Wrappers
55. Writing a Table Sampling Method
55.1. Sampling Method Support Functions
56. Writing a Custom Scan Provider
56.1. Creating Custom Scan Paths
56.2. Creating Custom Scan Plans
56.3. Executing Custom Scans
57. Genetic Query Optimizer
57.1. Query Handling as a Complex Optimization Problem
57.2. Genetic Algorithms
57.3. Genetic Query Optimization (GEQO) in LightDB
57.4. Further Reading
58. Table Access Method Interface Definition
59. Index Access Method Interface Definition
59.1. Basic API Structure for Indexes
59.2. Index Access Method Functions
59.3. Index Scanning
59.4. Index Locking Considerations
59.5. Index Uniqueness Checks
59.6. Index Cost Estimation Functions
60. Generic WAL Records
61. B-Tree Indexes
61.1. Introduction
61.2. Behavior of B-Tree Operator Classes
61.3. B-Tree Support Functions
61.4. Implementation
62. GiST Indexes
62.1. Introduction
62.2. Built-in Operator Classes
62.3. Extensibility
62.4. Implementation
62.5. Examples
63. SP-GiST Indexes
63.1. Introduction
63.2. Built-in Operator Classes
63.3. Extensibility
63.4. Implementation
63.5. Examples
64. GIN Indexes
64.1. Introduction
64.2. Built-in Operator Classes
64.3. Extensibility
64.4. Implementation
64.5. GIN Tips and Tricks
64.6. Limitations
64.7. Examples
65. BRIN Indexes
65.1. Introduction
65.2. Built-in Operator Classes
65.3. Extensibility
66. Database Physical Storage
66.1. Database File Layout
66.2. TOAST
66.3. Free Space Map
66.4. Visibility Map
66.5. The Initialization Fork
66.6. Database Page Layout
67. System Catalog Declarations and Initial Contents
67.1. System Catalog Declaration Rules
67.2. System Catalog Initial Data
67.3. BKI File Format
67.4. BKI Commands
67.5. Structure of the Bootstrap BKI File
67.6. BKI Example
68. How the Planner Uses Statistics
68.1. Row Estimation Examples
68.2. Multivariate Statistics Examples
68.3. Planner Statistics and Security
69. Backup Manifest Format
69.1. Backup Manifest Top-level Object
69.2. Backup Manifest File Object
69.3. Backup Manifest WAL Range Object