gcc/ChangeLog: * doc/invoke.texi (-fvar-tracking-assignments): New. (-fvar-tracking-assignments-toggle): New. (-fdump-final-insns=file): Mark filename as optional. (--param min-nondebug-insn-uid): New. (-gdwarf-@{version}): Mention version 4. * opts.c (common_handle_option): Accept it. * tree-vrp.c (find_assert_locations_1): Skip debug stmts. * regrename.c (regrename_optimize): Drop last. Don't count debug insns as uses. Don't reject change because of debug insn. (do_replace): Reject DEBUG_INSN as chain starter. Take base_regno from the chain starter, and check for inexact matches in DEBUG_INSNS. (scan_rtx_reg): Accept inexact matches in DEBUG_INSNs. (build_def_use): Simplify and fix the marking of DEBUG_INSNs. * sched-ebb.c (schedule_ebbs): Skip boundary debug insns. * fwprop.c (forward_propagate_and_simplify): ...into debug insns. * doc/gimple.texi (is_gimple_debug): New. (gimple_debug_bind_p): New. (is_gimple_call, gimple_assign_cast_p): End sentence with period. * doc/install.texi (bootstrap-debug): More details. (bootstrap-debug-big, bootstrap-debug-lean): Document. (bootstrap-debug-lib): More details. (bootstrap-debug-ckovw): Update. (bootstrap-time): New. * tree-into-ssa.c (mark_def_sites): Skip debug stmts. (insert_phi_nodes_for): Insert debug stmts. (rewrite_stmt): Take iterator. Insert debug stmts. (rewrite_enter_block): Adjust. (maybe_replace_use_in_debug_stmt): New. (rewrite_update_stmt): Use it. (mark_use_interesting): Return early for debug stmts. * tree-ssa-loop-im.c (rewrite_bittest): Propagate DEFs into debug stmts before replacing stmt. (move_computations_stmt): Likewise. * ira-conflicts.c (add_copies): Skip debug insns. * regstat.c (regstat_init_n_sets_and_refs): Discount debug insns. (regstat_bb_compute_ri): Skip debug insns. * tree-ssa-threadupdate.c (redirection_block_p): Skip debug stmts. * tree-ssa-loop-manip.c (find_uses_to_rename_stmt, check_loop_closed_ssa_stmt): Skip debug stmts. * tree-tailcall.c (find_tail_calls): Likewise. * tree-ssa-loop-ch.c (should_duplicate_loop_header_p): Likewise. * tree.h (MAY_HAVE_DEBUG_STMTS): New. (build_var_debug_value_stat): Declare. (build_var_debug_value): Define. (target_for_debug_bind): Declare. * reload.c (find_equiv_reg): Skip debug insns. * rtlanal.c (reg_used_between_p): Skip debug insns. (side_effects_p): Likewise. (canonicalize_condition): Likewise. * ddg.c (create_ddg_dep_from_intra_loop_link): Check that non-debug insns never depend on debug insns. (create_ddg_dep_no_link): Likewise. (add_cross_iteration_register_deps): Use ANTI_DEP for debug insns. Don't add inter-loop dependencies for debug insns. (build_intra_loop_deps): Likewise. (create_ddg): Count debug insns. * ddg.h (struct ddg::num_debug): New. (num_backargs): Pair up with previous int field. * diagnostic.c (diagnostic_report_diagnostic): Skip notes on -fcompare-debug-second. * final.c (get_attr_length_1): Skip debug insns. (rest_of_clean-state): Don't dump CFA_RESTORE_STATE. * gcc.c (invoke_as): Call compare-debug-dump-opt. (driver_self_specs): Map -fdump-final-insns to -fdump-final-insns=.. (get_local_tick): New. (compare_debug_dump_opt_spec_function): Test for . argument and compute output name. Compute temp output spec without flag name. Compute -frandom-seed. (OPT): Undef after use. * cfgloopanal.c (num_loop_insns): Skip debug insns. (average_num_loop_insns): Likewise. * params.h (MIN_NONDEBUG_INSN_UID): New. * gimple.def (GIMPLE_DEBUG): New. * ipa-reference.c (scan_stmt_for_static_refs): Skip debug stmts. * auto-inc-dec.c (merge_in_block): Skip debug insns. (merge_in_block): Fix whitespace. * toplev.c (flag_var_tracking): Update comment. (flag_var_tracking_assignments): New. (flag_var_tracking_assignments_toggle): New. (process_options): Don't open final insns dump file if we're not going to write to it. Compute defaults for var_tracking. * df-scan.c (df_insn_rescan_debug_internal): New. (df_uses_record): Handle debug insns. * haifa-sched.c (ready): Initialize n_debug. (contributes_to_priority): Skip debug insns. (dep_list_size): New. (priority): Use it. (rank_for_schedule): Likewise. Schedule debug insns as soon as they're ready. Disregard previous debug insns to make decisions. (queue_insn): Never queue debug insns. (ready_add, ready_remove_first, ready_remove): Count debug insns. (schedule_insn): Don't reject debug insns because of issue rate. (get_ebb_head_tail, no_real_insns_p): Skip boundary debug insns. (queue_to_ready): Skip and discount debug insns. (choose_ready): Let debug insns through. (schedule_block): Check boundary debug insns. Discount debug insns, schedule them early. Adjust whitespace. (set_priorities): Check for boundary debug insns. (add_jump_dependencies): Use dep_list_size. (prev_non_location_insn): New. (check_cfg): Use it. * tree-ssa-loop-ivopts.c (find-interesting_users): Skip debug stmts. (remove_unused_ivs): Reset debug stmts. * modulo-sched.c (const_iteration_count): Skip debug insns. (res_MII): Discount debug insns. (loop_single_full_bb_p): Skip debug insns. (sms_schedule): Likewise. (sms_schedule_by_order): Likewise. (ps_has_conflicts): Likewise. * caller-save.c (refmarker_fn): New. (save_call_clobbered_regs): Replace regs with saved mem in debug insns. (mark_referenced_regs): Take pointer, mark and arg. Adjust. Call refmarker_fn mark for hardregnos. (mark_reg_as_referenced): New. (replace_reg_with_saved_mem): New. * ipa-pure-const.c (check_stmt): Skip debug stmts. * cse.c (cse_insn): Canonicalize debug insns. Skip them when searching back. (cse_extended_basic_block): Skip debug insns. (count_reg_usage): Likewise. (is_dead_reg): New, split out of... (set_live_p): ... here. (insn_live_p): Use it for debug insns. * tree-stdarg.c (check_all_va_list_escapes): Skip debug stmts. (execute_optimize_stdarg): Likewise. * tree-ssa-dom.c (propagate_rhs_into_lhs): Likewise. * tree-ssa-propagate.c (substitute_and_fold): Don't regard changes in debug stmts as changes. * sel-sched.c (moving_insn_creates_bookkeeping_block_p): New. (moveup_expr): Don't move across debug insns. Don't move debug insn if it would create a bookkeeping block. (moveup_expr_cached): Don't use cache for debug insns that are heads of blocks. (compute_av_set_inside_bb): Skip debug insns. (sel_rank_for_schedule): Schedule debug insns first. Remove dead code. (block_valid_for_bookkeeping_p); Support lax searches. (create_block_for_bookkeeping): Adjust block numbers when encountering debug-only blocks. (find_place_for_bookkeeping): Deal with debug-only blocks. (generate_bookkeeping_insn): Accept no place to insert. (remove_temp_moveop_nops): New argument full_tidying. (prepare_place_to_insert): Deal with debug insns. (advance_state_on_fence): Debug insns don't start cycles. (update_boundaries): Take fence as argument. Deal with debug insns. (schedule_expr_on_boundary): No full_tidying on debug insns. (fill_insns): Deal with debug insns. (track_scheduled_insns_and_blocks): Don't count debug insns. (need_nop_to_preserve_insn_bb): New, split out of... (remove_insn_from_stream): ... this. (fur_orig_expr_not_found): Skip debug insns. * rtl.def (VALUE): Move up. (DEBUG_INSN): New. * tree-ssa-sink.c (all_immediate_uses_same_place): Skip debug stmts. (nearest_common_dominator_of_uses): Take debug_stmts argument. Set it if debug stmts are found. (statement_sink_location): Skip debug stmts. Propagate moving defs into debug stmts. * ifcvt.c (first_active_insn): Skip debug insns. (last_active_insns): Likewise. (cond_exec_process_insns): Likewise. (noce_process_if_block): Likewise. (check_cond_move_block): Likewise. (cond_move_convert_if_block): Likewise. (block_jumps_and_fallthru_p): Likewise. (dead_or_predicable): Likewise. * dwarf2out.c (debug_str_hash_forced): New. (find_AT_string): Add comment. (gen_label_for_indirect_string): New. (get_debug_string_label): New. (AT_string_form): Use it. (mem_loc_descriptor): Handle non-TLS symbols. Handle MINUS , DIV, MOD, AND, IOR, XOR, NOT, ABS, NEG, and CONST_STRING. Accept but discard COMPARE, IF_THEN_ELSE, ROTATE, ROTATERT, TRUNCATE and several operations that cannot be represented with DWARF opcodes. (loc_descriptor): Ignore SIGN_EXTEND and ZERO_EXTEND. Require dwarf_version 4 for DW_OP_implicit_value and DW_OP_stack_value. (dwarf2out_var_location): Take during-call mark into account. (output_indirect_string): Update comment. Output if there are label and references. (prune_indirect_string): New. (prune_unused_types): Call it if debug_str_hash_forced. More in dwarf2out.c, from Jakub Jelinek <jakub@redhat.com>: (dw_long_long_const): Remove. (struct dw_val_struct): Change val_long_long type to rtx. (print_die, attr_checksum, same_dw_val_p, loc_descriptor): Adjust for val_long_long change to CONST_DOUBLE rtx from a long hi/lo pair. (output_die): Likewise. Use HOST_BITS_PER_WIDE_INT size of each component instead of HOST_BITS_PER_LONG. (output_loc_operands): Likewise. For const8* assert HOST_BITS_PER_WIDE_INT rather than HOST_BITS_PER_LONG is >= 64. (output_loc_operands_raw): For const8* assert HOST_BITS_PER_WIDE_INT rather than HOST_BITS_PER_LONG is >= 64. (add_AT_long_long): Remove val_hi and val_lo arguments, add val_const_double. (size_of_die): Use HOST_BITS_PER_WIDE_INT size multiplier instead of HOST_BITS_PER_LONG for dw_val_class_long_long. (add_const_value_attribute): Adjust add_AT_long_long caller. Don't handle TLS SYMBOL_REFs. If CONST wraps a constant, tail recurse. (dwarf_stack_op_name): Handle DW_OP_implicit_value and DW_OP_stack_value. (size_of_loc_descr, output_loc_operands, output_loc_operands_raw): Handle DW_OP_implicit_value. (extract_int): Move prototype earlier. (mem_loc_descriptor): For SUBREG punt if inner mode size is wider than DWARF2_ADDR_SIZE. Handle SIGN_EXTEND and ZERO_EXTEND by DW_OP_shl and DW_OP_shr{a,}. Handle EQ, NE, GT, GE, LT, LE, GTU, GEU, LTU, LEU, SMIN, SMAX, UMIN, UMAX, SIGN_EXTRACT, ZERO_EXTRACT. (loc_descriptor): Compare mode size with DWARF2_ADDR_SIZE instead of Pmode size. (loc_descriptor): Add MODE argument. Handle CONST_INT, CONST_DOUBLE, CONST_VECTOR, CONST, LABEL_REF and SYMBOL_REF if mode != VOIDmode, attempt to handle other expressions. Don't handle TLS SYMBOL_REFs. (concat_loc_descriptor, concatn_loc_descriptor, loc_descriptor_from_tree_1): Adjust loc_descriptor callers. (add_location_or_const_value_attribute): Likewise. For single location loc_lists attempt to use add_const_value_attribute for constant decls. Add DW_AT_const_value even if NOTE_VAR_LOCATION is VAR_LOCATION with CONSTANT_P or CONST_STRING in its expression. * cfgbuild.c (inside_basic_block_p): Handle debug insns. (control_flow_insn_p): Likewise. * tree-parloops.c (eliminate_local_variables_stmt): Handle debug stmt. (separate_decls_in_region_debug_bind): New. (separate_decls_in_region): Process debug bind stmts afterwards. * recog.c (verify_changes): Handle debug insns. (extract_insn): Likewise. (peephole2_optimize): Skip debug insns. * dse.c (scan_insn): Skip debug insns. * sel-sched-ir.c (return_nop_to_pool): Take full_tidying argument. Pass it on. (setup_id_for_insn): Handle debug insns. (maybe_tidy_empty_bb): Adjust whitespace. (tidy_control_flow): Skip debug insns. (sel_remove_insn): Adjust for debug insns. (sel_estimate_number_of_insns): Skip debug insns. (create_insn_rtx_from_pattern): Handle debug insns. (create_copy_of_insn_rtx): Likewise. * sel-sched-.h (sel_bb_end): Declare. (sel_bb_empty_or_nop_p): New. (get_all_loop_exits): Use it. (_eligible_successor_edge_p): Likewise. (return_nop_to_pool): Adjust. * tree-eh.c (tre_empty_eh_handler_p): Skip debug stmts. * ira-lives.c (process_bb_node_lives): Skip debug insns. * gimple-pretty-print.c (dump_gimple_debug): New. (dump_gimple_stmt): Use it. (dump_bb_header): Skip gimple debug stmts. * regmove.c (optimize_reg_copy_1): Discount debug insns. (fixup_match_2): Likewise. (regmove_backward_pass): Likewise. Simplify combined replacement. Handle debug insns. * function.c (instantiate_virtual_regs): Handle debug insns. * function.h (struct emit_status): Add x_cur_debug_insn_uid. * print-rtl.h: Include cselib.h. (print_rtx): Print VALUEs. Split out and recurse for VAR_LOCATIONs. * df.h (df_inns_rescan_debug_internal): Declare. * gcse.c (alloc_hash_table): Estimate n_insns. (cprop_insn): Don't regard debug insns as changes. (bypass_conditional_jumps): Skip debug insns. (one_pre_gcse_pass): Adjust. (one_code_hoisting_pass): Likewise. (compute_ld_motion_mems): Skip debug insns. (one_cprop_pass): Adjust. * tree-if-conv.c (tree_if_convert_stmt): Reset debug stmts. (if_convertible_stmt_p): Handle debug stmts. * init-regs.c (initialize_uninitialized_regs): Skip debug insns. * tree-vect-loop.c (vect_is_simple_reduction): Skip debug stmts. * ira-build.c (create_bb_allocnos): Skip debug insns. * tree-flow-inline.h (has_zero_uses): Discount debug stmts. (has_single_use): Likewise. (single_imm_use): Likewise. (num_imm_uses): Likewise. * tree-ssa-phiopt.c (empty_block_p): Skip debug stmts. * tree-ssa-coalesce.c (build_ssa_conflict_graph): Skip debug stmts. (create_outofssa_var_map): Likewise. * lower-subreg.c (adjust_decomposed_uses): New. (resolve_debug): New. (decompose_multiword_subregs): Use it. * tree-dfa.c (find_referenced_vars): Skip debug stmts. * emit-rtl.c: Include params.h. (cur_debug_insn_uid): Define. (set_new_first_and_last_insn): Set cur_debug_insn_uid too. (copy_rtx_if_shared_1): Handle debug insns. (reset_used_flags): Likewise. (set_used_flags): LIkewise. (get_max_insn_count): New. (next_nondebug_insn): New. (prev_nondebug_insn): New. (make_debug_insn_raw): New. (emit_insn_before_noloc): Handle debug insns. (emit_jump_insn_before_noloc): Likewise. (emit_call_insn_before_noloc): Likewise. (emit_debug_insn_before_noloc): New. (emit_insn_after_noloc): Handle debug insns. (emit_jump_insn_after_noloc): Likewise. (emit_call_insn_after_noloc): Likewise. (emit_debug_insn_after_noloc): Likewise. (emit_insn_after): Take loc from earlier non-debug insn. (emit_jump_insn_after): Likewise. (emit_call_insn_after): Likewise. (emit_debug_insn_after_setloc): New. (emit_debug_insn_after): New. (emit_insn_before): Take loc from later non-debug insn. (emit_jump_insn_before): Likewise. (emit_call_insn_before): Likewise. (emit_debug_insn_before_setloc): New. (emit_debug_insn_before): New. (emit_insn): Handle debug insns. (emit_debug_insn): New. (emit_jump_insn): Handle debug insns. (emit_call_insn): Likewise. (emit): Likewise. (init_emit): Take min-nondebug-insn-uid into account. Initialize cur_debug_insn_uid. (emit_copy_of_insn_after): Handle debug insns. * cfgexpand.c (gimple_assign_rhs_to_tree): Do not overwrite location of single rhs in place. (maybe_dump_rtl_for_gimple_stmt): Dump lineno. (floor_sdiv_adjust): New. (cell_sdiv_adjust): New. (cell_udiv_adjust): New. (round_sdiv_adjust): New. (round_udiv_adjust): New. (wrap_constant): Moved from cselib. (unwrap_constant): New. (expand_debug_expr): New. (expand_debug_locations): New. (expand_gimple_basic_block): Drop hiding redeclaration. Expand debug bind stmts. (gimple_expand_cfg): Expand debug locations. * cselib.c: Include tree-pass.h. (struct expand_value_data): New. (cselib_record_sets_hook): New. (PRESERVED_VALUE_P, LONG_TERM_PRESERVED_VALUE_P): New. (cselib_clear_table): Move, and implemnet in terms of... (cselib_reset_table_with_next_value): ... this. (cselib_get_next_unknown_value): New. (discard_useless_locs): Don't discard preserved values. (cselib_preserve_value): New. (cselib_preserved_value_p): New. (cselib_preserve_definitely): New. (cselib_clear_preserve): New. (cselib_preserve_only_values): New. (new_cselib_val): Take rtx argument. Dump it in details. (cselib_lookup_mem): Adjust. (expand_loc): Take regs_active in struct. Adjust. Silence dumps unless details are requested. (cselib_expand_value_rtx_cb): New. (cselib_expand_value_rtx): Rename and reimplment in terms of... (cselib_expand_value_rtx_1): ... this. Adjust. Silence dumps without details. Copy more subregs. Try to resolve values using a callback. Wrap constants. (cselib_subst_to_values): Adjust. (cselib_log_lookup): New. (cselib_lookup): Call it. (cselib_invalidate_regno): Don't count preserved values as useless. (cselib_invalidate_mem): Likewise. (cselib_record_set): Likewise. (struct set): Renamed to cselib_set, moved to cselib.h. (cselib_record_sets): Adjust. Call hook. (cselib_process_insn): Reset table when it would be cleared. (dump_cselib_val): New. (dump_cselib_table): New. * tree-cfgcleanup.c (tree_forwarded_block_p): Skip debug stmts. (remove_forwarder_block): Support moving debug stmts. * cselib.h (cselib_record_sets_hook): Declare. (cselib_expand_callback): New type. (cselib_expand_value_rtx_cb): Declare. (cselib_reset_table_with_next_value): Declare. (cselib_get_next_unknown_value): Declare. (cselib_preserve_value): Declare. (cselib_preserved_value_p): Declare. (cselib_preserve_only_values): Declare. (dump_cselib_table): Declare. * cfgcleanup.c (flow_find_cross_jump): Skip debug insns. (try_crossjump_to_edge): Likewise. (delete_unreachable_blocks): Remove dominant GIMPLE blocks after dominated blocks when debug stmts are present. * simplify-rtx.c (delegitimize_mem_from_attrs): New. * tree-ssa-live.c (remove_unused_locals): Skip debug stmts. (set_var_live_on_entry): Likewise. * loop-invariant.c (find_invariants_bb): Skip debug insns. * cfglayout.c (curr_location, last_location): Make static. (set_curr_insn_source_location): Don't avoid bouncing. (get_curr_insn_source_location): New. (get_curr_insn_block): New. (duplicate_insn_chain): Handle debug insns. * tree-ssa-forwprop.c (forward_propagate_addr_expr): Propagate into debug stmts. * common.opt (fcompare-debug): Move to sort order. (fdump-unnumbered-links): Likewise. (fvar-tracking-assignments): New. (fvar-tracking-assignments-toggle): New. * tree-ssa-dce.c (mark_stmt_necessary): Don't mark blocks because of debug stmts. (mark_stmt_if_obviously_necessary): Mark debug stmts. (eliminate_unnecessary_stmts): Walk dominated blocks before dominators. * tree-ssa-ter.c (find_replaceable_in_bb): Skip debug stmts. * ira.c (memref_used_between_p): Skip debug insns. (update_equiv_regs): Likewise. * sched-deps.c (sd_lists_size): Accept empty list. (sd_init_insn): Mark debug insns. (sd_finish_insn): Unmark them. (sd_add_dep): Reject non-debug deps on debug insns. (fixup_sched_groups): Give debug insns group treatment. Skip debug insns. (sched_analyze_reg): Don't mark debug insns for sched before call. (sched_analyze_2): Handle debug insns. (sched_analyze_insn): Compute next non-debug insn. Handle debug insns. (deps_analyze_insn): Handle debug insns. (deps_start_bb): Skip debug insns. (init_deps): Initialize last_debug_insn. * tree-ssa.c (target_for_debug_bind): New. (find_released_ssa_name): New. (propagate_var_def_into_debug_stmts): New. (propagate_defs_into_debug_stmts): New. (verify_ssa): Skip debug bind stmts without values. (warn_uninialized_vars): Skip debug stmts. * target-def.h (TARGET_DELEGITIMIZE_ADDRESS): Set default. * rtl.c (rtx_equal_p_cb): Handle VALUEs. (rtx_equal_p): Likewise. * ira-costs.c (scan_one_insn): Skip debug insns. (process_bb_node_for_hard_reg_moves): Likewise. * rtl.h (DEBUG_INSN_P): New. (NONDEBUG_INSN_P): New. (MAY_HAVE_DEBUG_INSNS): New. (INSN_P): Accept debug insns. (RTX_FRAME_RELATED_P): Likewise. (INSN_DELETED_P): Likewise (PAT_VAR_LOCATION_DECL): New. (PAT_VAR_LOCATION_LOC): New. (PAT_VAR_OCATION_STATUS): New. (NOTE_VAR_LOCATION_DECL): Reimplement. (NOTE_VAR_LOCATION_LOC): Likewise. (NOTE_VAR_LOCATION_STATUS): Likewise. (INSN_VAR_LOCATION): New. (INSN_VAR_LOCATION_DECL): New. (INSN_VAR_LOCATION_LOC): New. (INSN_VAR_LOCATION_STATUS): New. (gen_rtx_UNKNOWN_VAR_LOC): New. (VAR_LOC_UNKNOWN_P): New. (NOTE_DURING_CALL_P): New. (SCHED_GROUP_P): Accept debug insns. (emit_debug_insn_before): Declare. (emit_debug_insn_before_noloc): Declare. (emit_debug_insn_beore_setloc): Declare. (emit_debug_insn_after): Declare. (emit_debug_insn_after_noloc): Declare. (emit_debug_insn_after_setloc): Declare. (emit_debug_insn): Declare. (make_debug_insn_raw): Declare. (prev_nondebug_insn): Declare. (next_nondebug_insn): Declare. (delegitimize_mem_from_attrs): Declare. (get_max_insn_count): Declare. (wrap_constant): Declare. (unwrap_constant): Declare. (get_curr_insn_source_location): Declare. (get_curr_insn_block): Declare. * tree-inline.c (insert_debug_decl_map): New. (processing_debug_stmt): New. (remap_decl): Don't create new mappings in debug stmts. (remap_gimple_op_r): Don't add references in debug stmts. (copy_tree_body_r): Likewise. (remap_gimple_stmt): Handle debug bind stmts. (copy_bb): Skip debug stmts. (copy_edges_for_bb): Likewise. (copy_debug_stmt): New. (copy_debug_stmts): New. (copy_body): Copy debug stmts at the end. (insert_init_debug_bind): New. (insert_init_stmt): Take id. Skip and emit debug stmts. (setup_one_parameter): Remap variable earlier, register debug mapping. (estimate_num_insns): Skip debug stmts. (expand_call_inline): Preserve debug_map. (optimize_inline_calls): Check for no debug_stmts left-overs. (unsave_expr_now): Preserve debug_map. (copy_gimple_seq_and_replace_locals): Likewise. (tree_function_versioning): Check for no debug_stmts left-overs. Init and destroy debug_map as needed. Split edges unconditionally. (build_duplicate_type): Init and destroy debug_map as needed. * tree-inline.h: Include gimple.h instead of pointer-set.h. (struct copy_body_data): Add debug_stmts and debug_map. * sched-int.h (struct ready_list): Add n_debug. (struct deps): Add last_debug_insn. (DEBUG_INSN_SCHED_P): New. (BOUNDARY_DEBUG_INSN_P): New. (SCHEDULE_DEBUG_INSN_P): New. (sd_iterator_cond): Accept empty list. * combine.c (create_log_links): Skip debug insns. (combine_instructions): Likewise. (cleanup_auto_inc_dec): New. From Jakub Jelinek: Make sure the return value is always unshared. (struct rtx_subst_pair): New. (auto_adjust_pair): New. (propagate_for_debug_subst): New. (propagate_for_debug): New. (try_combine): Skip debug insns. Propagate removed defs into debug insns. (next_nonnote_nondebug_insn): New. (distribute_notes): Use it. Skip debug insns. (distribute_links): Skip debug insns. * tree-outof-ssa.c (set_location_for_edge): Likewise. * resource.c (mark_target_live_regs): Likewise. * var-tracking.c: Include cselib.h and target.h. (enum micro_operation_type): Add MO_VAL_USE, MO_VAL_LOC, and MO_VAL_SET. (micro_operation_type_name): New. (enum emit_note_where): Add EMIT_NOTE_AFTER_CALL_INSN. (struct micro_operation_def): Update comments. (decl_or_value): New type. Use instead of decls. (struct emit_note_data_def): Add vars. (struct attrs_def): Use decl_or_value. (struct variable_tracking_info_def): Add permp, flooded. (struct location_chain_def): Update comment. (struct variable_part_def): Use decl_or_value. (struct variable_def): Make var_part a variable length array. (valvar_pool): New. (scratch_regs): New. (cselib_hook_called): New. (dv_is_decl_p): New. (dv_is_value_p): New. (dv_as_decl): New. (dv_as_value): New. (dv_as_opaque): New. (dv_onepart_p): New. (dv_pool): New. (IS_DECL_CODE): New. (check_value_is_not_decl): New. (dv_from_decl): New. (dv_from_value): New. (dv_htab_hash): New. (variable_htab_hash): Use it. (variable_htab_eq): Support values. (variable_htab_free): Free from the right pool. (attrs_list_member, attrs_list_insert): Use decl_or_value. (attrs_list_union): Adjust. (attrs_list_mpdv_union): New. (tie_break_pointers): New. (canon_value_cmp): New. (unshare_variable): Return possibly-modified slot. (vars_copy_1): Adjust. (var_reg_decl_set): Adjust. Split out of... (var_reg_set): ... this. (get_init_value): Adjust. (var_reg_delete_and_set): Adjust. (var_reg_delete): Adjust. (var_regno_delete): Adjust. (var_mem_decl_set): Split out of... (var_mem_set): ... this. (var_mem_delete_and_set): Adjust. (var_mem_delete): Adjust. (val_store): New. (val_reset): New. (val_resolve): New. (variable_union): Adjust. Speed up merge of 1-part vars. (variable_canonicalize): Use unshared slot. (VALUED_RECURSED_INTO): New. (find_loc_in_1pdv): New. (struct dfset_merge): New. (insert_into_intersection): New. (intersect_loc_chains): New. (loc_cmp): New. (canonicalize_loc_order_check): New. (canonicalize_values_mark): New. (canonicalize_values_star): New. (variable_merge_over_cur): New. (variable_merge_over_src): New. (dataflow_set_merge): New. (dataflow_set_equiv_regs): New. (remove_duplicate_values): New. (struct dfset_post_merge): New. (variable_post_merge_new_vals): New. (variable_post_merge_perm_vals): New. (dataflow_post_merge_adjust): New. (find_mem_expr_in_1pdv): New. (dataflow_set_preserve_mem_locs): New. (dataflow_set_remove_mem_locs): New. (dataflow_set_clear_at_call): New. (onepart_variable_different_p): New. (variable_different_p): Use it. (dataflow_set_different_1): Adjust. Make detailed dump more verbose. (track_expr_p): Add need_rtl parameter. Don't generate rtl if not needed. (track_loc_p): Pass it true. (struct count_use_info): New. (find_use_val): New. (replace_expr_with_values): New. (log_op_type): New. (use_type): New, partially split out of... (count_uses): ... this. Count new micro-ops. (count_uses_1): Adjust. (count_stores): Adjust. (count_with_sets): New. (VAL_NEEDS_RESOLUTION): New. (VAL_HOLDS_TRACK_EXPR): New. (VAL_EXPR_IS_COPIED): New. (VAL_EXPR_IS_CLOBBERED): New. (add_uses): Adjust. Generate new micro-ops. (add_uses_1): Adjust. (add_stores): Generate new micro-ops. (add_with_sets): New. (find_src_status): Adjust. (find_src_set_src): Adjust. (compute_bb_dataflow): Use dataflow_set_clear_at_call. Handle new micro-ops. Canonicalize value equivalances. (vt_find_locations): Compute total size of hash tables for dumping. Perform merge for var-tracking-assignments. Don't disregard single-block loops. (dump_attrs_list): Handle decl_or_value. (dump_variable): Take variable. Deal with decl_or_value. (dump_variable_slot): New. (dump_vars): Use it. (dump_dataflow_sets): Adjust. (set_slot_part): New, extended to support one-part variables after splitting out of... (set_variable_part): ... this. (clobber_slot_part): New, split out of... (clobber_variable_part): ... this. (delete_slot_part): New, split out of... (delete_variable_part): .... this. (check_wrap_constant): New. (vt_expand_loc_callback): New. (vt_expand_loc): New. (emit_note_insn_var_location): Adjust. Handle values. Handle EMIT_NOTE_AFTER_CALL_INSN. (emit_notes_for_differences_1): Adjust. Handle values. (emit_notes_for_differences_2): Likewise. (emit_notes_for_differences): Adjust. (emit_notes_in_bb): Take pointer to set. Emit AFTER_CALL_INSN notes. Adjust. Handle new micro-ops. (vt_add_function_parameters): Adjust. Create and bind values. (vt_initialize): Adjust. Initialize scratch_regs and valvar_pool, flooded and perm.. Initialize and use cselib. Log operations. Move some code to count_with_sets and add_with_sets. (delete_debug_insns): New. (vt_debug_insns_local): New. (vt_finalize): Release permp, valvar_pool, scratch_regs. Finish cselib. (var_tracking_main): If var-tracking-assignments is enabled but var-tracking isn't, delete debug insns and leave. Likewise if we exceed limits or fail the stack adjustments tests, and after all var-tracking processing. More in var-tracking, from Jakub Jelinek <jakub@redhat.com>: (dataflow_set): Add traversed_vars. (value_chain, const_value_chain): New typedefs. (value_chain_pool, value_chains): New variables. (value_chain_htab_hash, value_chain_htab_eq, add_value_chain, add_value_chains, add_cselib_value_chains, remove_value_chain, remove_value_chains, remove_cselib_value_chains): New functions. (shared_hash_find_slot_unshare_1, shared_hash_find_slot_1, shared_hash_find_slot_noinsert_1, shared_hash_find_1): New static inlines. (shared_hash_find_slot_unshare, shared_hash_find_slot, shared_hash_find_slot_noinsert, shared_hash_find): Update. (dst_can_be_shared): New variable. (unshare_variable): Unshare set->vars if shared, use shared_hash_*. Clear dst_can_be_shared. If set->traversed_vars is non-NULL and different from set->vars, look up slot again instead of using the passed in slot. (dataflow_set_init): Initialize traversed_vars. (variable_union): Use shared_hash_*. Use initially NO_INSERT lookup if set->vars is shared. Don't keep slot cleared before calling unshare_variable. Unshare set->vars if needed. Adjust unshare_variable callers. Clear dst_can_be_shared if needed. Even ->refcount == 1 vars must be unshared if set->vars is shared and var needs to be modified. (dataflow_set_union): Set traversed_vars during canonicalization. (VALUE_CHANGED, DECL_CHANGED): Define. (set_dv_changed, dv_changed_p): New static inlines. (track_expr_p): Clear DECL_CHANGED. (dump_dataflow_sets): Set it. (variable_was_changed): Call set_dv_changed. (emit_note_insn_var_location): Likewise. (changed_variables_stack): New variable. (check_changed_vars_1, check_changed_vars_2): New functions. (emit_notes_for_changes): Do nothing if changed_variables is empty. Traverse changed_variables with check_changed_vars_1, call check_changed_vars_2 on each changed_variables_stack entry. (emit_notes_in_bb): Add SET argument. Just clear it at the beginning, use it instead of local &set, don't destroy it at the end. (vt_emit_notes): Call dataflow_set_clear early on all VTI(bb)->out sets, never use them, instead use emit_notes_in_bb computed set, dataflow_set_clear also VTI(bb)->in when we are done with the basic block. Initialize changed_variables_stack, free it afterwards. If ENABLE_CHECKING verify that after noting differences to an empty set value_chains hash table is empty. (vt_initialize): Initialize value_chains and value_chain_pool. (vt_finalize): Delete value_chains htab, free value_chain_pool. (variable_tracking_main): Call dump_dataflow_sets before calling vt_emit_notes, not after it. * tree-flow.h (propagate_defs_into_debug_stmts): Declare. (propagate_var_def_into_debug_stmts): Declare. * df-problems.c (df_lr_bb_local_compute): Skip debug insns. (df_set_note): Reject debug insns. (df_whole_mw_reg_dead_p): Take added_notes_p argument. Don't add notes to debug insns. (df_note_bb_compute): Adjust. Likewise. (df_simulate_uses): Skip debug insns. (df_simulate_initialize_backwards): Likewise. * reg-stack.c (subst_stack_regs_in_debug_insn): New. (subst_stack_regs_pat): Reject debug insns. (convert_regs_1): Handle debug insns. * Makefile.in (TREE_INLINE_H): Take pointer-set.h from GIMPLE_H. (print-rtl.o): Depend on cselib.h. (cselib.o): Depend on TREE_PASS_H. (var-tracking.o): Depend on cselib.h and TARGET_H. * sched-rgn.c (rgn_estimate_number_of_insns): Discount debug insns. (init_ready_list): Skip boundary debug insns. (add_branch_dependences): Skip debug insns. (free_block_dependencies): Check for blocks with only debug insns. (compute_priorities): Likewise. * gimple.c (gss_for_code): Handle GIMPLE_DEBUG. (gimple_build_with_ops_stat): Take subcode as unsigned. Adjust all callers. (gimple_build_debug_bind_stat): New. (empty_body_p): Skip debug stmts. (gimple_has_side_effects): Likewise. (gimple_rhs_has_side_effects): Likewise. * gimple.h (enum gimple_debug_subcode, GIMPLE_DEBUG_BIND): New. (gimple_build_debug_bind_stat): Declare. (gimple_build_debug_bind): Define. (is_gimple_debug): New. (gimple_debug_bind_p): New. (gimple_debug_bind_get_var): New. (gimple_debug_bind_get_value): New. (gimple_debug_bind_get_value_ptr): New. (gimple_debug_bind_set_var): New. (gimple_debug_bind_set_value): New. (GIMPLE_DEBUG_BIND_NOVALUE): New internal temporary macro. (gimple_debug_bind_reset_value): New. (gimple_debug_bind_has_value_p): New. (gsi_next_nondebug): New. (gsi_prev_nondebug): New. (gsi_start_nondebug_bb): New. (gsi_last_nondebug_bb): New. * sched-vis.c (print_pattern): Handle VAR_LOCATION. (print_insn): Handle DEBUG_INSN. * tree-cfg.c (remove_bb): Walk stmts backwards. Let loc of first insn prevail. (first_stmt): Skip debug stmts. (first_non_label_stmt): Likewise. (last_stmt): Likewise. (has_zero_uses_1): New. (single_imm_use_1): New. (verify_gimple_debug): New. (verify_types_in_gimple_stmt): Handle debug stmts. (verify_stmt): Likewise. (debug_loop_num): Skip debug stmts. (remove_edge_and_dominated_blocks): Remove dominators last. * tree-ssa-reasssoc.c (rewrite_expr_tree): Propagate into debug stmts. (linearize_expr): Likewise. * config/i386/i386.c (ix86_delegitimize_address): Call default implementation. * config/ia64/ia64.c (ia64_safe_itanium_class): Handle debug insns. (group_barrier_needed): Skip debug insns. (emit_insn_group_barriers): Likewise. (emit_all_insn_group_barriers): Likewise. (ia64_variable_issue): Handle debug insns. (ia64_dfa_new_cycle): Likewise. (final_emit_insn_group_barriers): Skip debug insns. (ia64_dwarf2out_def_steady_cfa): Take frame argument. Don't def cfa without frame. (process_set): Likewise. (process_for_unwind_directive): Pass frame on. * config/rs6000/rs6000.c (TARGET_DELEGITIMIZE_ADDRESS): Define. (rs6000_delegitimize_address): New. (rs6000_debug_adjust_cost): Handle debug insns. (is_microcoded_insn): Likewise. (is_cracked_insn): Likewise. (is_nonpipeline_insn): Likewise. (insn_must_be_first_in_group): Likewise. (insn_must_be_last_in_group): Likewise. (force_new_group): Likewise. * cfgrtl.c (rtl_split_block): Emit INSN_DELETED note if block contains only debug insns. (rtl_merge_blocks): Skip debug insns. (purge_dead_edges): Likewise. (rtl_block_ends_with_call_p): Skip debug insns. * dce.c (deletable_insn_p): Handle VAR_LOCATION. (mark_reg_dependencies): Skip debug insns. * params.def (PARAM_MIN_NONDEBUG_INSN_UID): New. * tree-ssanames.c (release_ssa_name): Propagate def into debug stmts. * tree-ssa-threadedge.c (record_temporary_equivalences_from_stmts): Skip debug stmts. * regcprop.c (replace_oldest_value_addr): Skip debug insns. (replace_oldest_value_mem): Use ALL_REGS for debug insns. (copyprop_hardreg_forward_1): Handle debug insns. * reload1.c (reload): Skip debug insns. Replace unassigned pseudos in debug insns with their equivalences. (eliminate_regs_in_insn): Skip debug insns. (emit_input_reload_insns): Skip debug insns at first, adjust them later. * tree-ssa-operands.c (add_virtual_operand): Reject debug stmts. (get_indirect_ref_operands): Pass opf_no_vops on. (get_expr_operands): Likewise. Skip debug stmts. (parse_ssa_operands): Scan debug insns with opf_no_vops. gcc/testsuite/ChangeLog: * gcc.dg/guality/guality.c: New. * gcc.dg/guality/guality.h: New. * gcc.dg/guality/guality.exp: New. * gcc.dg/guality/example.c: New. * lib/gcc-dg.exp (cleanup-dump): Remove .gk files. (cleanup-saved-temps): Likewise, .gkd files too. gcc/cp/ChangeLog: * cp-tree.h (TFF_NO_OMIT_DEFAULT_TEMPLATE_ARGUMENTS): New. * cp-lang.c (cxx_dwarf_name): Pass it. * error.c (count_non_default_template_args): Take flags as argument. Adjust all callers. Skip counting of default arguments if the new flag is given. ChangeLog: * Makefile.tpl (BUILD_CONFIG): Default to bootstrap-debug. * Makefile.in: Rebuilt. contrib/ChangeLog: * compare-debug: Look for .gkd files and compare them. config/ChangeLog: * bootstrap-debug.mk: Add comments. * bootstrap-debug-big.mk: New. * bootstrap-debug-lean.mk: New. * bootstrap-debug-ckovw.mk: Add comments. * bootstrap-debug-lib.mk: Drop CFLAGS for stages. Use -g0 for TFLAGS in stage1. Drop -fvar-tracking-assignments-toggle. From-SVN: r151312
1205 lines
34 KiB
C
1205 lines
34 KiB
C
/* Generic SSA value propagation engine.
|
|
Copyright (C) 2004, 2005, 2006, 2007, 2008 Free Software Foundation, Inc.
|
|
Contributed by Diego Novillo <dnovillo@redhat.com>
|
|
|
|
This file is part of GCC.
|
|
|
|
GCC is free software; you can redistribute it and/or modify it
|
|
under the terms of the GNU General Public License as published by the
|
|
Free Software Foundation; either version 3, or (at your option) any
|
|
later version.
|
|
|
|
GCC is distributed in the hope that it will be useful, but WITHOUT
|
|
ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
|
|
FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
|
|
for more details.
|
|
|
|
You should have received a copy of the GNU General Public License
|
|
along with GCC; see the file COPYING3. If not see
|
|
<http://www.gnu.org/licenses/>. */
|
|
|
|
#include "config.h"
|
|
#include "system.h"
|
|
#include "coretypes.h"
|
|
#include "tm.h"
|
|
#include "tree.h"
|
|
#include "flags.h"
|
|
#include "rtl.h"
|
|
#include "tm_p.h"
|
|
#include "ggc.h"
|
|
#include "basic-block.h"
|
|
#include "output.h"
|
|
#include "expr.h"
|
|
#include "function.h"
|
|
#include "diagnostic.h"
|
|
#include "timevar.h"
|
|
#include "tree-dump.h"
|
|
#include "tree-flow.h"
|
|
#include "tree-pass.h"
|
|
#include "tree-ssa-propagate.h"
|
|
#include "langhooks.h"
|
|
#include "varray.h"
|
|
#include "vec.h"
|
|
#include "value-prof.h"
|
|
#include "gimple.h"
|
|
|
|
/* This file implements a generic value propagation engine based on
|
|
the same propagation used by the SSA-CCP algorithm [1].
|
|
|
|
Propagation is performed by simulating the execution of every
|
|
statement that produces the value being propagated. Simulation
|
|
proceeds as follows:
|
|
|
|
1- Initially, all edges of the CFG are marked not executable and
|
|
the CFG worklist is seeded with all the statements in the entry
|
|
basic block (block 0).
|
|
|
|
2- Every statement S is simulated with a call to the call-back
|
|
function SSA_PROP_VISIT_STMT. This evaluation may produce 3
|
|
results:
|
|
|
|
SSA_PROP_NOT_INTERESTING: Statement S produces nothing of
|
|
interest and does not affect any of the work lists.
|
|
|
|
SSA_PROP_VARYING: The value produced by S cannot be determined
|
|
at compile time. Further simulation of S is not required.
|
|
If S is a conditional jump, all the outgoing edges for the
|
|
block are considered executable and added to the work
|
|
list.
|
|
|
|
SSA_PROP_INTERESTING: S produces a value that can be computed
|
|
at compile time. Its result can be propagated into the
|
|
statements that feed from S. Furthermore, if S is a
|
|
conditional jump, only the edge known to be taken is added
|
|
to the work list. Edges that are known not to execute are
|
|
never simulated.
|
|
|
|
3- PHI nodes are simulated with a call to SSA_PROP_VISIT_PHI. The
|
|
return value from SSA_PROP_VISIT_PHI has the same semantics as
|
|
described in #2.
|
|
|
|
4- Three work lists are kept. Statements are only added to these
|
|
lists if they produce one of SSA_PROP_INTERESTING or
|
|
SSA_PROP_VARYING.
|
|
|
|
CFG_BLOCKS contains the list of blocks to be simulated.
|
|
Blocks are added to this list if their incoming edges are
|
|
found executable.
|
|
|
|
VARYING_SSA_EDGES contains the list of statements that feed
|
|
from statements that produce an SSA_PROP_VARYING result.
|
|
These are simulated first to speed up processing.
|
|
|
|
INTERESTING_SSA_EDGES contains the list of statements that
|
|
feed from statements that produce an SSA_PROP_INTERESTING
|
|
result.
|
|
|
|
5- Simulation terminates when all three work lists are drained.
|
|
|
|
Before calling ssa_propagate, it is important to clear
|
|
prop_simulate_again_p for all the statements in the program that
|
|
should be simulated. This initialization allows an implementation
|
|
to specify which statements should never be simulated.
|
|
|
|
It is also important to compute def-use information before calling
|
|
ssa_propagate.
|
|
|
|
References:
|
|
|
|
[1] Constant propagation with conditional branches,
|
|
Wegman and Zadeck, ACM TOPLAS 13(2):181-210.
|
|
|
|
[2] Building an Optimizing Compiler,
|
|
Robert Morgan, Butterworth-Heinemann, 1998, Section 8.9.
|
|
|
|
[3] Advanced Compiler Design and Implementation,
|
|
Steven Muchnick, Morgan Kaufmann, 1997, Section 12.6 */
|
|
|
|
/* Function pointers used to parameterize the propagation engine. */
|
|
static ssa_prop_visit_stmt_fn ssa_prop_visit_stmt;
|
|
static ssa_prop_visit_phi_fn ssa_prop_visit_phi;
|
|
|
|
/* Keep track of statements that have been added to one of the SSA
|
|
edges worklists. This flag is used to avoid visiting statements
|
|
unnecessarily when draining an SSA edge worklist. If while
|
|
simulating a basic block, we find a statement with
|
|
STMT_IN_SSA_EDGE_WORKLIST set, we clear it to prevent SSA edge
|
|
processing from visiting it again.
|
|
|
|
NOTE: users of the propagation engine are not allowed to use
|
|
the GF_PLF_1 flag. */
|
|
#define STMT_IN_SSA_EDGE_WORKLIST GF_PLF_1
|
|
|
|
/* A bitmap to keep track of executable blocks in the CFG. */
|
|
static sbitmap executable_blocks;
|
|
|
|
/* Array of control flow edges on the worklist. */
|
|
static VEC(basic_block,heap) *cfg_blocks;
|
|
|
|
static unsigned int cfg_blocks_num = 0;
|
|
static int cfg_blocks_tail;
|
|
static int cfg_blocks_head;
|
|
|
|
static sbitmap bb_in_list;
|
|
|
|
/* Worklist of SSA edges which will need reexamination as their
|
|
definition has changed. SSA edges are def-use edges in the SSA
|
|
web. For each D-U edge, we store the target statement or PHI node
|
|
U. */
|
|
static GTY(()) VEC(gimple,gc) *interesting_ssa_edges;
|
|
|
|
/* Identical to INTERESTING_SSA_EDGES. For performance reasons, the
|
|
list of SSA edges is split into two. One contains all SSA edges
|
|
who need to be reexamined because their lattice value changed to
|
|
varying (this worklist), and the other contains all other SSA edges
|
|
to be reexamined (INTERESTING_SSA_EDGES).
|
|
|
|
Since most values in the program are VARYING, the ideal situation
|
|
is to move them to that lattice value as quickly as possible.
|
|
Thus, it doesn't make sense to process any other type of lattice
|
|
value until all VARYING values are propagated fully, which is one
|
|
thing using the VARYING worklist achieves. In addition, if we
|
|
don't use a separate worklist for VARYING edges, we end up with
|
|
situations where lattice values move from
|
|
UNDEFINED->INTERESTING->VARYING instead of UNDEFINED->VARYING. */
|
|
static GTY(()) VEC(gimple,gc) *varying_ssa_edges;
|
|
|
|
|
|
/* Return true if the block worklist empty. */
|
|
|
|
static inline bool
|
|
cfg_blocks_empty_p (void)
|
|
{
|
|
return (cfg_blocks_num == 0);
|
|
}
|
|
|
|
|
|
/* Add a basic block to the worklist. The block must not be already
|
|
in the worklist, and it must not be the ENTRY or EXIT block. */
|
|
|
|
static void
|
|
cfg_blocks_add (basic_block bb)
|
|
{
|
|
bool head = false;
|
|
|
|
gcc_assert (bb != ENTRY_BLOCK_PTR && bb != EXIT_BLOCK_PTR);
|
|
gcc_assert (!TEST_BIT (bb_in_list, bb->index));
|
|
|
|
if (cfg_blocks_empty_p ())
|
|
{
|
|
cfg_blocks_tail = cfg_blocks_head = 0;
|
|
cfg_blocks_num = 1;
|
|
}
|
|
else
|
|
{
|
|
cfg_blocks_num++;
|
|
if (cfg_blocks_num > VEC_length (basic_block, cfg_blocks))
|
|
{
|
|
/* We have to grow the array now. Adjust to queue to occupy
|
|
the full space of the original array. We do not need to
|
|
initialize the newly allocated portion of the array
|
|
because we keep track of CFG_BLOCKS_HEAD and
|
|
CFG_BLOCKS_HEAD. */
|
|
cfg_blocks_tail = VEC_length (basic_block, cfg_blocks);
|
|
cfg_blocks_head = 0;
|
|
VEC_safe_grow (basic_block, heap, cfg_blocks, 2 * cfg_blocks_tail);
|
|
}
|
|
/* Minor optimization: we prefer to see blocks with more
|
|
predecessors later, because there is more of a chance that
|
|
the incoming edges will be executable. */
|
|
else if (EDGE_COUNT (bb->preds)
|
|
>= EDGE_COUNT (VEC_index (basic_block, cfg_blocks,
|
|
cfg_blocks_head)->preds))
|
|
cfg_blocks_tail = ((cfg_blocks_tail + 1)
|
|
% VEC_length (basic_block, cfg_blocks));
|
|
else
|
|
{
|
|
if (cfg_blocks_head == 0)
|
|
cfg_blocks_head = VEC_length (basic_block, cfg_blocks);
|
|
--cfg_blocks_head;
|
|
head = true;
|
|
}
|
|
}
|
|
|
|
VEC_replace (basic_block, cfg_blocks,
|
|
head ? cfg_blocks_head : cfg_blocks_tail,
|
|
bb);
|
|
SET_BIT (bb_in_list, bb->index);
|
|
}
|
|
|
|
|
|
/* Remove a block from the worklist. */
|
|
|
|
static basic_block
|
|
cfg_blocks_get (void)
|
|
{
|
|
basic_block bb;
|
|
|
|
bb = VEC_index (basic_block, cfg_blocks, cfg_blocks_head);
|
|
|
|
gcc_assert (!cfg_blocks_empty_p ());
|
|
gcc_assert (bb);
|
|
|
|
cfg_blocks_head = ((cfg_blocks_head + 1)
|
|
% VEC_length (basic_block, cfg_blocks));
|
|
--cfg_blocks_num;
|
|
RESET_BIT (bb_in_list, bb->index);
|
|
|
|
return bb;
|
|
}
|
|
|
|
|
|
/* We have just defined a new value for VAR. If IS_VARYING is true,
|
|
add all immediate uses of VAR to VARYING_SSA_EDGES, otherwise add
|
|
them to INTERESTING_SSA_EDGES. */
|
|
|
|
static void
|
|
add_ssa_edge (tree var, bool is_varying)
|
|
{
|
|
imm_use_iterator iter;
|
|
use_operand_p use_p;
|
|
|
|
FOR_EACH_IMM_USE_FAST (use_p, iter, var)
|
|
{
|
|
gimple use_stmt = USE_STMT (use_p);
|
|
|
|
if (prop_simulate_again_p (use_stmt)
|
|
&& !gimple_plf (use_stmt, STMT_IN_SSA_EDGE_WORKLIST))
|
|
{
|
|
gimple_set_plf (use_stmt, STMT_IN_SSA_EDGE_WORKLIST, true);
|
|
if (is_varying)
|
|
VEC_safe_push (gimple, gc, varying_ssa_edges, use_stmt);
|
|
else
|
|
VEC_safe_push (gimple, gc, interesting_ssa_edges, use_stmt);
|
|
}
|
|
}
|
|
}
|
|
|
|
|
|
/* Add edge E to the control flow worklist. */
|
|
|
|
static void
|
|
add_control_edge (edge e)
|
|
{
|
|
basic_block bb = e->dest;
|
|
if (bb == EXIT_BLOCK_PTR)
|
|
return;
|
|
|
|
/* If the edge had already been executed, skip it. */
|
|
if (e->flags & EDGE_EXECUTABLE)
|
|
return;
|
|
|
|
e->flags |= EDGE_EXECUTABLE;
|
|
|
|
/* If the block is already in the list, we're done. */
|
|
if (TEST_BIT (bb_in_list, bb->index))
|
|
return;
|
|
|
|
cfg_blocks_add (bb);
|
|
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
fprintf (dump_file, "Adding Destination of edge (%d -> %d) to worklist\n\n",
|
|
e->src->index, e->dest->index);
|
|
}
|
|
|
|
|
|
/* Simulate the execution of STMT and update the work lists accordingly. */
|
|
|
|
static void
|
|
simulate_stmt (gimple stmt)
|
|
{
|
|
enum ssa_prop_result val = SSA_PROP_NOT_INTERESTING;
|
|
edge taken_edge = NULL;
|
|
tree output_name = NULL_TREE;
|
|
|
|
/* Don't bother visiting statements that are already
|
|
considered varying by the propagator. */
|
|
if (!prop_simulate_again_p (stmt))
|
|
return;
|
|
|
|
if (gimple_code (stmt) == GIMPLE_PHI)
|
|
{
|
|
val = ssa_prop_visit_phi (stmt);
|
|
output_name = gimple_phi_result (stmt);
|
|
}
|
|
else
|
|
val = ssa_prop_visit_stmt (stmt, &taken_edge, &output_name);
|
|
|
|
if (val == SSA_PROP_VARYING)
|
|
{
|
|
prop_set_simulate_again (stmt, false);
|
|
|
|
/* If the statement produced a new varying value, add the SSA
|
|
edges coming out of OUTPUT_NAME. */
|
|
if (output_name)
|
|
add_ssa_edge (output_name, true);
|
|
|
|
/* If STMT transfers control out of its basic block, add
|
|
all outgoing edges to the work list. */
|
|
if (stmt_ends_bb_p (stmt))
|
|
{
|
|
edge e;
|
|
edge_iterator ei;
|
|
basic_block bb = gimple_bb (stmt);
|
|
FOR_EACH_EDGE (e, ei, bb->succs)
|
|
add_control_edge (e);
|
|
}
|
|
}
|
|
else if (val == SSA_PROP_INTERESTING)
|
|
{
|
|
/* If the statement produced new value, add the SSA edges coming
|
|
out of OUTPUT_NAME. */
|
|
if (output_name)
|
|
add_ssa_edge (output_name, false);
|
|
|
|
/* If we know which edge is going to be taken out of this block,
|
|
add it to the CFG work list. */
|
|
if (taken_edge)
|
|
add_control_edge (taken_edge);
|
|
}
|
|
}
|
|
|
|
/* Process an SSA edge worklist. WORKLIST is the SSA edge worklist to
|
|
drain. This pops statements off the given WORKLIST and processes
|
|
them until there are no more statements on WORKLIST.
|
|
We take a pointer to WORKLIST because it may be reallocated when an
|
|
SSA edge is added to it in simulate_stmt. */
|
|
|
|
static void
|
|
process_ssa_edge_worklist (VEC(gimple,gc) **worklist)
|
|
{
|
|
/* Drain the entire worklist. */
|
|
while (VEC_length (gimple, *worklist) > 0)
|
|
{
|
|
basic_block bb;
|
|
|
|
/* Pull the statement to simulate off the worklist. */
|
|
gimple stmt = VEC_pop (gimple, *worklist);
|
|
|
|
/* If this statement was already visited by simulate_block, then
|
|
we don't need to visit it again here. */
|
|
if (!gimple_plf (stmt, STMT_IN_SSA_EDGE_WORKLIST))
|
|
continue;
|
|
|
|
/* STMT is no longer in a worklist. */
|
|
gimple_set_plf (stmt, STMT_IN_SSA_EDGE_WORKLIST, false);
|
|
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
{
|
|
fprintf (dump_file, "\nSimulating statement (from ssa_edges): ");
|
|
print_gimple_stmt (dump_file, stmt, 0, dump_flags);
|
|
}
|
|
|
|
bb = gimple_bb (stmt);
|
|
|
|
/* PHI nodes are always visited, regardless of whether or not
|
|
the destination block is executable. Otherwise, visit the
|
|
statement only if its block is marked executable. */
|
|
if (gimple_code (stmt) == GIMPLE_PHI
|
|
|| TEST_BIT (executable_blocks, bb->index))
|
|
simulate_stmt (stmt);
|
|
}
|
|
}
|
|
|
|
|
|
/* Simulate the execution of BLOCK. Evaluate the statement associated
|
|
with each variable reference inside the block. */
|
|
|
|
static void
|
|
simulate_block (basic_block block)
|
|
{
|
|
gimple_stmt_iterator gsi;
|
|
|
|
/* There is nothing to do for the exit block. */
|
|
if (block == EXIT_BLOCK_PTR)
|
|
return;
|
|
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
fprintf (dump_file, "\nSimulating block %d\n", block->index);
|
|
|
|
/* Always simulate PHI nodes, even if we have simulated this block
|
|
before. */
|
|
for (gsi = gsi_start_phis (block); !gsi_end_p (gsi); gsi_next (&gsi))
|
|
simulate_stmt (gsi_stmt (gsi));
|
|
|
|
/* If this is the first time we've simulated this block, then we
|
|
must simulate each of its statements. */
|
|
if (!TEST_BIT (executable_blocks, block->index))
|
|
{
|
|
gimple_stmt_iterator j;
|
|
unsigned int normal_edge_count;
|
|
edge e, normal_edge;
|
|
edge_iterator ei;
|
|
|
|
/* Note that we have simulated this block. */
|
|
SET_BIT (executable_blocks, block->index);
|
|
|
|
for (j = gsi_start_bb (block); !gsi_end_p (j); gsi_next (&j))
|
|
{
|
|
gimple stmt = gsi_stmt (j);
|
|
|
|
/* If this statement is already in the worklist then
|
|
"cancel" it. The reevaluation implied by the worklist
|
|
entry will produce the same value we generate here and
|
|
thus reevaluating it again from the worklist is
|
|
pointless. */
|
|
if (gimple_plf (stmt, STMT_IN_SSA_EDGE_WORKLIST))
|
|
gimple_set_plf (stmt, STMT_IN_SSA_EDGE_WORKLIST, false);
|
|
|
|
simulate_stmt (stmt);
|
|
}
|
|
|
|
/* We can not predict when abnormal and EH edges will be executed, so
|
|
once a block is considered executable, we consider any
|
|
outgoing abnormal edges as executable.
|
|
|
|
TODO: This is not exactly true. Simplifying statement might
|
|
prove it non-throwing and also computed goto can be handled
|
|
when destination is known.
|
|
|
|
At the same time, if this block has only one successor that is
|
|
reached by non-abnormal edges, then add that successor to the
|
|
worklist. */
|
|
normal_edge_count = 0;
|
|
normal_edge = NULL;
|
|
FOR_EACH_EDGE (e, ei, block->succs)
|
|
{
|
|
if (e->flags & (EDGE_ABNORMAL | EDGE_EH))
|
|
add_control_edge (e);
|
|
else
|
|
{
|
|
normal_edge_count++;
|
|
normal_edge = e;
|
|
}
|
|
}
|
|
|
|
if (normal_edge_count == 1)
|
|
add_control_edge (normal_edge);
|
|
}
|
|
}
|
|
|
|
|
|
/* Initialize local data structures and work lists. */
|
|
|
|
static void
|
|
ssa_prop_init (void)
|
|
{
|
|
edge e;
|
|
edge_iterator ei;
|
|
basic_block bb;
|
|
|
|
/* Worklists of SSA edges. */
|
|
interesting_ssa_edges = VEC_alloc (gimple, gc, 20);
|
|
varying_ssa_edges = VEC_alloc (gimple, gc, 20);
|
|
|
|
executable_blocks = sbitmap_alloc (last_basic_block);
|
|
sbitmap_zero (executable_blocks);
|
|
|
|
bb_in_list = sbitmap_alloc (last_basic_block);
|
|
sbitmap_zero (bb_in_list);
|
|
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
dump_immediate_uses (dump_file);
|
|
|
|
cfg_blocks = VEC_alloc (basic_block, heap, 20);
|
|
VEC_safe_grow (basic_block, heap, cfg_blocks, 20);
|
|
|
|
/* Initially assume that every edge in the CFG is not executable.
|
|
(including the edges coming out of ENTRY_BLOCK_PTR). */
|
|
FOR_ALL_BB (bb)
|
|
{
|
|
gimple_stmt_iterator si;
|
|
|
|
for (si = gsi_start_bb (bb); !gsi_end_p (si); gsi_next (&si))
|
|
gimple_set_plf (gsi_stmt (si), STMT_IN_SSA_EDGE_WORKLIST, false);
|
|
|
|
for (si = gsi_start_phis (bb); !gsi_end_p (si); gsi_next (&si))
|
|
gimple_set_plf (gsi_stmt (si), STMT_IN_SSA_EDGE_WORKLIST, false);
|
|
|
|
FOR_EACH_EDGE (e, ei, bb->succs)
|
|
e->flags &= ~EDGE_EXECUTABLE;
|
|
}
|
|
|
|
/* Seed the algorithm by adding the successors of the entry block to the
|
|
edge worklist. */
|
|
FOR_EACH_EDGE (e, ei, ENTRY_BLOCK_PTR->succs)
|
|
add_control_edge (e);
|
|
}
|
|
|
|
|
|
/* Free allocated storage. */
|
|
|
|
static void
|
|
ssa_prop_fini (void)
|
|
{
|
|
VEC_free (gimple, gc, interesting_ssa_edges);
|
|
VEC_free (gimple, gc, varying_ssa_edges);
|
|
VEC_free (basic_block, heap, cfg_blocks);
|
|
cfg_blocks = NULL;
|
|
sbitmap_free (bb_in_list);
|
|
sbitmap_free (executable_blocks);
|
|
}
|
|
|
|
|
|
/* Return true if EXPR is an acceptable right-hand-side for a
|
|
GIMPLE assignment. We validate the entire tree, not just
|
|
the root node, thus catching expressions that embed complex
|
|
operands that are not permitted in GIMPLE. This function
|
|
is needed because the folding routines in fold-const.c
|
|
may return such expressions in some cases, e.g., an array
|
|
access with an embedded index addition. It may make more
|
|
sense to have folding routines that are sensitive to the
|
|
constraints on GIMPLE operands, rather than abandoning any
|
|
any attempt to fold if the usual folding turns out to be too
|
|
aggressive. */
|
|
|
|
bool
|
|
valid_gimple_rhs_p (tree expr)
|
|
{
|
|
enum tree_code code = TREE_CODE (expr);
|
|
|
|
switch (TREE_CODE_CLASS (code))
|
|
{
|
|
case tcc_declaration:
|
|
if (!is_gimple_variable (expr))
|
|
return false;
|
|
break;
|
|
|
|
case tcc_constant:
|
|
/* All constants are ok. */
|
|
break;
|
|
|
|
case tcc_binary:
|
|
case tcc_comparison:
|
|
if (!is_gimple_val (TREE_OPERAND (expr, 0))
|
|
|| !is_gimple_val (TREE_OPERAND (expr, 1)))
|
|
return false;
|
|
break;
|
|
|
|
case tcc_unary:
|
|
if (!is_gimple_val (TREE_OPERAND (expr, 0)))
|
|
return false;
|
|
break;
|
|
|
|
case tcc_expression:
|
|
switch (code)
|
|
{
|
|
case ADDR_EXPR:
|
|
{
|
|
tree t;
|
|
if (is_gimple_min_invariant (expr))
|
|
return true;
|
|
t = TREE_OPERAND (expr, 0);
|
|
while (handled_component_p (t))
|
|
{
|
|
/* ??? More checks needed, see the GIMPLE verifier. */
|
|
if ((TREE_CODE (t) == ARRAY_REF
|
|
|| TREE_CODE (t) == ARRAY_RANGE_REF)
|
|
&& !is_gimple_val (TREE_OPERAND (t, 1)))
|
|
return false;
|
|
t = TREE_OPERAND (t, 0);
|
|
}
|
|
if (!is_gimple_id (t))
|
|
return false;
|
|
}
|
|
break;
|
|
|
|
case TRUTH_NOT_EXPR:
|
|
if (!is_gimple_val (TREE_OPERAND (expr, 0)))
|
|
return false;
|
|
break;
|
|
|
|
case TRUTH_AND_EXPR:
|
|
case TRUTH_XOR_EXPR:
|
|
case TRUTH_OR_EXPR:
|
|
if (!is_gimple_val (TREE_OPERAND (expr, 0))
|
|
|| !is_gimple_val (TREE_OPERAND (expr, 1)))
|
|
return false;
|
|
break;
|
|
|
|
case EXC_PTR_EXPR:
|
|
case FILTER_EXPR:
|
|
break;
|
|
|
|
default:
|
|
return false;
|
|
}
|
|
break;
|
|
|
|
case tcc_vl_exp:
|
|
return false;
|
|
|
|
case tcc_exceptional:
|
|
if (code != SSA_NAME)
|
|
return false;
|
|
break;
|
|
|
|
default:
|
|
return false;
|
|
}
|
|
|
|
return true;
|
|
}
|
|
|
|
|
|
/* Return true if EXPR is a CALL_EXPR suitable for representation
|
|
as a single GIMPLE_CALL statement. If the arguments require
|
|
further gimplification, return false. */
|
|
|
|
bool
|
|
valid_gimple_call_p (tree expr)
|
|
{
|
|
unsigned i, nargs;
|
|
|
|
if (TREE_CODE (expr) != CALL_EXPR)
|
|
return false;
|
|
|
|
nargs = call_expr_nargs (expr);
|
|
for (i = 0; i < nargs; i++)
|
|
if (! is_gimple_operand (CALL_EXPR_ARG (expr, i)))
|
|
return false;
|
|
|
|
return true;
|
|
}
|
|
|
|
|
|
/* Make SSA names defined by OLD_STMT point to NEW_STMT
|
|
as their defining statement. */
|
|
|
|
void
|
|
move_ssa_defining_stmt_for_defs (gimple new_stmt, gimple old_stmt)
|
|
{
|
|
tree var;
|
|
ssa_op_iter iter;
|
|
|
|
if (gimple_in_ssa_p (cfun))
|
|
{
|
|
/* Make defined SSA_NAMEs point to the new
|
|
statement as their definition. */
|
|
FOR_EACH_SSA_TREE_OPERAND (var, old_stmt, iter, SSA_OP_ALL_DEFS)
|
|
{
|
|
if (TREE_CODE (var) == SSA_NAME)
|
|
SSA_NAME_DEF_STMT (var) = new_stmt;
|
|
}
|
|
}
|
|
}
|
|
|
|
|
|
/* Update a GIMPLE_CALL statement at iterator *SI_P to reflect the
|
|
value of EXPR, which is expected to be the result of folding the
|
|
call. This can only be done if EXPR is a CALL_EXPR with valid
|
|
GIMPLE operands as arguments, or if it is a suitable RHS expression
|
|
for a GIMPLE_ASSIGN. More complex expressions will require
|
|
gimplification, which will introduce addtional statements. In this
|
|
event, no update is performed, and the function returns false.
|
|
Note that we cannot mutate a GIMPLE_CALL in-place, so we always
|
|
replace the statement at *SI_P with an entirely new statement.
|
|
The new statement need not be a call, e.g., if the original call
|
|
folded to a constant. */
|
|
|
|
bool
|
|
update_call_from_tree (gimple_stmt_iterator *si_p, tree expr)
|
|
{
|
|
tree lhs;
|
|
|
|
gimple stmt = gsi_stmt (*si_p);
|
|
|
|
gcc_assert (is_gimple_call (stmt));
|
|
|
|
lhs = gimple_call_lhs (stmt);
|
|
|
|
if (valid_gimple_call_p (expr))
|
|
{
|
|
/* The call has simplified to another call. */
|
|
tree fn = CALL_EXPR_FN (expr);
|
|
unsigned i;
|
|
unsigned nargs = call_expr_nargs (expr);
|
|
VEC(tree, heap) *args = NULL;
|
|
gimple new_stmt;
|
|
|
|
if (nargs > 0)
|
|
{
|
|
args = VEC_alloc (tree, heap, nargs);
|
|
VEC_safe_grow (tree, heap, args, nargs);
|
|
|
|
for (i = 0; i < nargs; i++)
|
|
VEC_replace (tree, args, i, CALL_EXPR_ARG (expr, i));
|
|
}
|
|
|
|
new_stmt = gimple_build_call_vec (fn, args);
|
|
gimple_call_set_lhs (new_stmt, lhs);
|
|
move_ssa_defining_stmt_for_defs (new_stmt, stmt);
|
|
gimple_set_vuse (new_stmt, gimple_vuse (stmt));
|
|
gimple_set_vdef (new_stmt, gimple_vdef (stmt));
|
|
gimple_set_location (new_stmt, gimple_location (stmt));
|
|
gsi_replace (si_p, new_stmt, false);
|
|
VEC_free (tree, heap, args);
|
|
|
|
return true;
|
|
}
|
|
else if (valid_gimple_rhs_p (expr))
|
|
{
|
|
gimple new_stmt;
|
|
|
|
/* The call has simplified to an expression
|
|
that cannot be represented as a GIMPLE_CALL. */
|
|
if (lhs)
|
|
{
|
|
/* A value is expected.
|
|
Introduce a new GIMPLE_ASSIGN statement. */
|
|
STRIP_USELESS_TYPE_CONVERSION (expr);
|
|
new_stmt = gimple_build_assign (lhs, expr);
|
|
move_ssa_defining_stmt_for_defs (new_stmt, stmt);
|
|
gimple_set_vuse (new_stmt, gimple_vuse (stmt));
|
|
gimple_set_vdef (new_stmt, gimple_vdef (stmt));
|
|
}
|
|
else if (!TREE_SIDE_EFFECTS (expr))
|
|
{
|
|
/* No value is expected, and EXPR has no effect.
|
|
Replace it with an empty statement. */
|
|
new_stmt = gimple_build_nop ();
|
|
unlink_stmt_vdef (stmt);
|
|
release_defs (stmt);
|
|
}
|
|
else
|
|
{
|
|
/* No value is expected, but EXPR has an effect,
|
|
e.g., it could be a reference to a volatile
|
|
variable. Create an assignment statement
|
|
with a dummy (unused) lhs variable. */
|
|
STRIP_USELESS_TYPE_CONVERSION (expr);
|
|
lhs = create_tmp_var (TREE_TYPE (expr), NULL);
|
|
new_stmt = gimple_build_assign (lhs, expr);
|
|
add_referenced_var (lhs);
|
|
lhs = make_ssa_name (lhs, new_stmt);
|
|
gimple_assign_set_lhs (new_stmt, lhs);
|
|
gimple_set_vuse (new_stmt, gimple_vuse (stmt));
|
|
gimple_set_vdef (new_stmt, gimple_vdef (stmt));
|
|
move_ssa_defining_stmt_for_defs (new_stmt, stmt);
|
|
}
|
|
gimple_set_location (new_stmt, gimple_location (stmt));
|
|
gsi_replace (si_p, new_stmt, false);
|
|
return true;
|
|
}
|
|
else
|
|
/* The call simplified to an expression that is
|
|
not a valid GIMPLE RHS. */
|
|
return false;
|
|
}
|
|
|
|
|
|
/* Entry point to the propagation engine.
|
|
|
|
VISIT_STMT is called for every statement visited.
|
|
VISIT_PHI is called for every PHI node visited. */
|
|
|
|
void
|
|
ssa_propagate (ssa_prop_visit_stmt_fn visit_stmt,
|
|
ssa_prop_visit_phi_fn visit_phi)
|
|
{
|
|
ssa_prop_visit_stmt = visit_stmt;
|
|
ssa_prop_visit_phi = visit_phi;
|
|
|
|
ssa_prop_init ();
|
|
|
|
/* Iterate until the worklists are empty. */
|
|
while (!cfg_blocks_empty_p ()
|
|
|| VEC_length (gimple, interesting_ssa_edges) > 0
|
|
|| VEC_length (gimple, varying_ssa_edges) > 0)
|
|
{
|
|
if (!cfg_blocks_empty_p ())
|
|
{
|
|
/* Pull the next block to simulate off the worklist. */
|
|
basic_block dest_block = cfg_blocks_get ();
|
|
simulate_block (dest_block);
|
|
}
|
|
|
|
/* In order to move things to varying as quickly as
|
|
possible,process the VARYING_SSA_EDGES worklist first. */
|
|
process_ssa_edge_worklist (&varying_ssa_edges);
|
|
|
|
/* Now process the INTERESTING_SSA_EDGES worklist. */
|
|
process_ssa_edge_worklist (&interesting_ssa_edges);
|
|
}
|
|
|
|
ssa_prop_fini ();
|
|
}
|
|
|
|
|
|
/* Return true if STMT is of the form 'mem_ref = RHS', where 'mem_ref'
|
|
is a non-volatile pointer dereference, a structure reference or a
|
|
reference to a single _DECL. Ignore volatile memory references
|
|
because they are not interesting for the optimizers. */
|
|
|
|
bool
|
|
stmt_makes_single_store (gimple stmt)
|
|
{
|
|
tree lhs;
|
|
|
|
if (gimple_code (stmt) != GIMPLE_ASSIGN
|
|
&& gimple_code (stmt) != GIMPLE_CALL)
|
|
return false;
|
|
|
|
if (!gimple_vdef (stmt))
|
|
return false;
|
|
|
|
lhs = gimple_get_lhs (stmt);
|
|
|
|
/* A call statement may have a null LHS. */
|
|
if (!lhs)
|
|
return false;
|
|
|
|
return (!TREE_THIS_VOLATILE (lhs)
|
|
&& (DECL_P (lhs)
|
|
|| REFERENCE_CLASS_P (lhs)));
|
|
}
|
|
|
|
|
|
/* Propagation statistics. */
|
|
struct prop_stats_d
|
|
{
|
|
long num_const_prop;
|
|
long num_copy_prop;
|
|
long num_pred_folded;
|
|
long num_dce;
|
|
};
|
|
|
|
static struct prop_stats_d prop_stats;
|
|
|
|
/* Replace USE references in statement STMT with the values stored in
|
|
PROP_VALUE. Return true if at least one reference was replaced. */
|
|
|
|
static bool
|
|
replace_uses_in (gimple stmt, prop_value_t *prop_value)
|
|
{
|
|
bool replaced = false;
|
|
use_operand_p use;
|
|
ssa_op_iter iter;
|
|
|
|
FOR_EACH_SSA_USE_OPERAND (use, stmt, iter, SSA_OP_USE)
|
|
{
|
|
tree tuse = USE_FROM_PTR (use);
|
|
tree val = prop_value[SSA_NAME_VERSION (tuse)].value;
|
|
|
|
if (val == tuse || val == NULL_TREE)
|
|
continue;
|
|
|
|
if (gimple_code (stmt) == GIMPLE_ASM
|
|
&& !may_propagate_copy_into_asm (tuse))
|
|
continue;
|
|
|
|
if (!may_propagate_copy (tuse, val))
|
|
continue;
|
|
|
|
if (TREE_CODE (val) != SSA_NAME)
|
|
prop_stats.num_const_prop++;
|
|
else
|
|
prop_stats.num_copy_prop++;
|
|
|
|
propagate_value (use, val);
|
|
|
|
replaced = true;
|
|
}
|
|
|
|
return replaced;
|
|
}
|
|
|
|
|
|
/* Replace propagated values into all the arguments for PHI using the
|
|
values from PROP_VALUE. */
|
|
|
|
static void
|
|
replace_phi_args_in (gimple phi, prop_value_t *prop_value)
|
|
{
|
|
size_t i;
|
|
bool replaced = false;
|
|
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
{
|
|
fprintf (dump_file, "Folding PHI node: ");
|
|
print_gimple_stmt (dump_file, phi, 0, TDF_SLIM);
|
|
}
|
|
|
|
for (i = 0; i < gimple_phi_num_args (phi); i++)
|
|
{
|
|
tree arg = gimple_phi_arg_def (phi, i);
|
|
|
|
if (TREE_CODE (arg) == SSA_NAME)
|
|
{
|
|
tree val = prop_value[SSA_NAME_VERSION (arg)].value;
|
|
|
|
if (val && val != arg && may_propagate_copy (arg, val))
|
|
{
|
|
if (TREE_CODE (val) != SSA_NAME)
|
|
prop_stats.num_const_prop++;
|
|
else
|
|
prop_stats.num_copy_prop++;
|
|
|
|
propagate_value (PHI_ARG_DEF_PTR (phi, i), val);
|
|
replaced = true;
|
|
|
|
/* If we propagated a copy and this argument flows
|
|
through an abnormal edge, update the replacement
|
|
accordingly. */
|
|
if (TREE_CODE (val) == SSA_NAME
|
|
&& gimple_phi_arg_edge (phi, i)->flags & EDGE_ABNORMAL)
|
|
SSA_NAME_OCCURS_IN_ABNORMAL_PHI (val) = 1;
|
|
}
|
|
}
|
|
}
|
|
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
{
|
|
if (!replaced)
|
|
fprintf (dump_file, "No folding possible\n");
|
|
else
|
|
{
|
|
fprintf (dump_file, "Folded into: ");
|
|
print_gimple_stmt (dump_file, phi, 0, TDF_SLIM);
|
|
fprintf (dump_file, "\n");
|
|
}
|
|
}
|
|
}
|
|
|
|
|
|
/* If the statement pointed by SI has a predicate whose value can be
|
|
computed using the value range information computed by VRP, compute
|
|
its value and return true. Otherwise, return false. */
|
|
|
|
static bool
|
|
fold_predicate_in (gimple_stmt_iterator *si)
|
|
{
|
|
bool assignment_p = false;
|
|
tree val;
|
|
gimple stmt = gsi_stmt (*si);
|
|
|
|
if (is_gimple_assign (stmt)
|
|
&& TREE_CODE_CLASS (gimple_assign_rhs_code (stmt)) == tcc_comparison)
|
|
{
|
|
assignment_p = true;
|
|
val = vrp_evaluate_conditional (gimple_assign_rhs_code (stmt),
|
|
gimple_assign_rhs1 (stmt),
|
|
gimple_assign_rhs2 (stmt),
|
|
stmt);
|
|
}
|
|
else if (gimple_code (stmt) == GIMPLE_COND)
|
|
val = vrp_evaluate_conditional (gimple_cond_code (stmt),
|
|
gimple_cond_lhs (stmt),
|
|
gimple_cond_rhs (stmt),
|
|
stmt);
|
|
else
|
|
return false;
|
|
|
|
|
|
if (val)
|
|
{
|
|
if (assignment_p)
|
|
val = fold_convert (gimple_expr_type (stmt), val);
|
|
|
|
if (dump_file)
|
|
{
|
|
fprintf (dump_file, "Folding predicate ");
|
|
print_gimple_expr (dump_file, stmt, 0, 0);
|
|
fprintf (dump_file, " to ");
|
|
print_generic_expr (dump_file, val, 0);
|
|
fprintf (dump_file, "\n");
|
|
}
|
|
|
|
prop_stats.num_pred_folded++;
|
|
|
|
if (is_gimple_assign (stmt))
|
|
gimple_assign_set_rhs_from_tree (si, val);
|
|
else
|
|
{
|
|
gcc_assert (gimple_code (stmt) == GIMPLE_COND);
|
|
if (integer_zerop (val))
|
|
gimple_cond_make_false (stmt);
|
|
else if (integer_onep (val))
|
|
gimple_cond_make_true (stmt);
|
|
else
|
|
gcc_unreachable ();
|
|
}
|
|
|
|
return true;
|
|
}
|
|
|
|
return false;
|
|
}
|
|
|
|
|
|
/* Perform final substitution and folding of propagated values.
|
|
|
|
PROP_VALUE[I] contains the single value that should be substituted
|
|
at every use of SSA name N_I. If PROP_VALUE is NULL, no values are
|
|
substituted.
|
|
|
|
If USE_RANGES_P is true, statements that contain predicate
|
|
expressions are evaluated with a call to vrp_evaluate_conditional.
|
|
This will only give meaningful results when called from tree-vrp.c
|
|
(the information used by vrp_evaluate_conditional is built by the
|
|
VRP pass).
|
|
|
|
Return TRUE when something changed. */
|
|
|
|
bool
|
|
substitute_and_fold (prop_value_t *prop_value, bool use_ranges_p)
|
|
{
|
|
basic_block bb;
|
|
bool something_changed = false;
|
|
|
|
if (prop_value == NULL && !use_ranges_p)
|
|
return false;
|
|
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
fprintf (dump_file, "\nSubstituting values and folding statements\n\n");
|
|
|
|
memset (&prop_stats, 0, sizeof (prop_stats));
|
|
|
|
/* Substitute values in every statement of every basic block. */
|
|
FOR_EACH_BB (bb)
|
|
{
|
|
gimple_stmt_iterator i;
|
|
|
|
/* Propagate known values into PHI nodes. */
|
|
if (prop_value)
|
|
for (i = gsi_start_phis (bb); !gsi_end_p (i); gsi_next (&i))
|
|
replace_phi_args_in (gsi_stmt (i), prop_value);
|
|
|
|
/* Propagate known values into stmts. Do a backward walk to expose
|
|
more trivially deletable stmts. */
|
|
for (i = gsi_last_bb (bb); !gsi_end_p (i);)
|
|
{
|
|
bool did_replace;
|
|
gimple stmt = gsi_stmt (i);
|
|
gimple old_stmt;
|
|
enum gimple_code code = gimple_code (stmt);
|
|
|
|
/* Ignore ASSERT_EXPRs. They are used by VRP to generate
|
|
range information for names and they are discarded
|
|
afterwards. */
|
|
|
|
if (code == GIMPLE_ASSIGN
|
|
&& TREE_CODE (gimple_assign_rhs1 (stmt)) == ASSERT_EXPR)
|
|
{
|
|
gsi_prev (&i);
|
|
continue;
|
|
}
|
|
|
|
/* No point propagating into a stmt whose result is not used,
|
|
but instead we might be able to remove a trivially dead stmt. */
|
|
if (gimple_get_lhs (stmt)
|
|
&& TREE_CODE (gimple_get_lhs (stmt)) == SSA_NAME
|
|
&& has_zero_uses (gimple_get_lhs (stmt))
|
|
&& !stmt_could_throw_p (stmt)
|
|
&& !gimple_has_side_effects (stmt))
|
|
{
|
|
gimple_stmt_iterator i2;
|
|
|
|
if (dump_file && dump_flags & TDF_DETAILS)
|
|
{
|
|
fprintf (dump_file, "Removing dead stmt ");
|
|
print_gimple_stmt (dump_file, stmt, 0, 0);
|
|
fprintf (dump_file, "\n");
|
|
}
|
|
prop_stats.num_dce++;
|
|
gsi_prev (&i);
|
|
i2 = gsi_for_stmt (stmt);
|
|
gsi_remove (&i2, true);
|
|
release_defs (stmt);
|
|
continue;
|
|
}
|
|
|
|
/* Replace the statement with its folded version and mark it
|
|
folded. */
|
|
did_replace = false;
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
{
|
|
fprintf (dump_file, "Folding statement: ");
|
|
print_gimple_stmt (dump_file, stmt, 0, TDF_SLIM);
|
|
}
|
|
|
|
/* If we have range information, see if we can fold
|
|
predicate expressions. */
|
|
if (use_ranges_p)
|
|
{
|
|
did_replace = fold_predicate_in (&i);
|
|
/* fold_predicate_in should not have reallocated STMT. */
|
|
gcc_assert (gsi_stmt (i) == stmt);
|
|
}
|
|
|
|
/* Only replace real uses if we couldn't fold the
|
|
statement using value range information. */
|
|
if (prop_value
|
|
&& !did_replace)
|
|
did_replace |= replace_uses_in (stmt, prop_value);
|
|
|
|
/* If we made a replacement, fold the statement. */
|
|
|
|
old_stmt = stmt;
|
|
if (did_replace)
|
|
fold_stmt (&i);
|
|
|
|
/* Some statements may be simplified using ranges. For
|
|
example, division may be replaced by shifts, modulo
|
|
replaced with bitwise and, etc. Do this after
|
|
substituting constants, folding, etc so that we're
|
|
presented with a fully propagated, canonicalized
|
|
statement. */
|
|
if (use_ranges_p)
|
|
did_replace |= simplify_stmt_using_ranges (&i);
|
|
|
|
/* Now cleanup. */
|
|
if (did_replace)
|
|
{
|
|
stmt = gsi_stmt (i);
|
|
|
|
/* If we cleaned up EH information from the statement,
|
|
remove EH edges. */
|
|
if (maybe_clean_or_replace_eh_stmt (old_stmt, stmt))
|
|
gimple_purge_dead_eh_edges (bb);
|
|
|
|
if (is_gimple_assign (stmt)
|
|
&& (get_gimple_rhs_class (gimple_assign_rhs_code (stmt))
|
|
== GIMPLE_SINGLE_RHS))
|
|
{
|
|
tree rhs = gimple_assign_rhs1 (stmt);
|
|
|
|
if (TREE_CODE (rhs) == ADDR_EXPR)
|
|
recompute_tree_invariant_for_addr_expr (rhs);
|
|
}
|
|
|
|
/* Determine what needs to be done to update the SSA form. */
|
|
update_stmt (stmt);
|
|
if (!is_gimple_debug (stmt))
|
|
something_changed = true;
|
|
}
|
|
|
|
if (dump_file && (dump_flags & TDF_DETAILS))
|
|
{
|
|
if (did_replace)
|
|
{
|
|
fprintf (dump_file, "Folded into: ");
|
|
print_gimple_stmt (dump_file, stmt, 0, TDF_SLIM);
|
|
fprintf (dump_file, "\n");
|
|
}
|
|
else
|
|
fprintf (dump_file, "Not folded\n");
|
|
}
|
|
|
|
gsi_prev (&i);
|
|
}
|
|
}
|
|
|
|
statistics_counter_event (cfun, "Constants propagated",
|
|
prop_stats.num_const_prop);
|
|
statistics_counter_event (cfun, "Copies propagated",
|
|
prop_stats.num_copy_prop);
|
|
statistics_counter_event (cfun, "Predicates folded",
|
|
prop_stats.num_pred_folded);
|
|
statistics_counter_event (cfun, "Statements deleted",
|
|
prop_stats.num_dce);
|
|
return something_changed;
|
|
}
|
|
|
|
#include "gt-tree-ssa-propagate.h"
|